package block
Author: Jörn Franke <zuinnote@gmail.com>
Type Members
-
class
DefaultSource extends RelationProvider
Author: Jörn Franke <zuinnote@gmail.com>
Author: Jörn Franke <zuinnote@gmail.com>
Defines a Spark data source for Ethereum Blockchcain based on hadoopcryptoledgerlibrary. This is read-only for existing data. It returns EthereumBlocks.
-
class
DefaultSource15 extends DefaultSource with DataSourceRegister
Author: Jörn Franke <zuinnote@gmail.com>
Author: Jörn Franke <zuinnote@gmail.com>
Extension of DefaultSource (which is Spark 1.3 and 1.4 compatible) for Spark 1.5 compatibility. Since the class is loaded through META-INF/services we can decouple the two to have Spark 1.5 byte-code loaded lazily.
This trick is adapted from spark elasticsearch-hadoop data source: <https://github.com/elastic/elasticsearch-hadoop>
-
implicit
class
EthereumBlockContext extends Serializable
Adds a method,
etheruemBlockFile, to SQLContext that allows reading Etheruem blockchain data as Ethereum blocks. -
final
case class
EthereumBlockRelation(location: String, maxBlockSize: Integer = ..., useDirectBuffer: Boolean = ..., enrich: Boolean = false, chainId: Integer = 1)(sqlContext: SQLContext) extends BaseRelation with TableScan with Serializable with Product
Defines the schema of a EthereumBlock for Spark SQL