block

Type Members

1. class DefaultSource extends RelationProvider

   

   Author: Jörn Franke <zuinnote@gmail.com>

   Author: Jörn Franke <zuinnote@gmail.com>

   Defines a Spark data source for Ethereum Blockchcain based on hadoopcryptoledgerlibrary. This is read-only for existing data. It returns EthereumBlocks.

2. class DefaultSource15 extends DefaultSource with DataSourceRegister

   

   Author: Jörn Franke <zuinnote@gmail.com>

   Author: Jörn Franke <zuinnote@gmail.com>

   Extension of DefaultSource (which is Spark 1.3 and 1.4 compatible) for Spark 1.5 compatibility. Since the class is loaded through META-INF/services we can decouple the two to have Spark 1.5 byte-code loaded lazily.

   This trick is adapted from spark elasticsearch-hadoop data source: <https://github.com/elastic/elasticsearch-hadoop>

3. implicit class EthereumBlockContext extends Serializable

   

   Adds a method, etheruemBlockFile, to SQLContext that allows reading Etheruem blockchain data as Ethereum blocks.

4. final case class EthereumBlockRelation(location: String, maxBlockSize: Integer = ..., useDirectBuffer: Boolean = ..., enrich: Boolean = false)(sqlContext: SQLContext) extends BaseRelation with TableScan with Serializable with Product

   

   Defines the schema of a EthereumBlock for Spark SQL