package block
Author: Jörn Franke <zuinnote@gmail.com>
Type Members
-
implicit
class
BitcoinBlockContext extends Serializable
Adds a method,
bitcoinBlockFile, to SQLContext that allows reading Bitcoin blockchain data as Bitcoin blocks. -
final
case class
BitcoinBlockRelation(location: String, maxBlockSize: Integer = ..., magic: String = ..., useDirectBuffer: Boolean = ..., isSplittable: Boolean = ..., readAuxPOW: Boolean = ..., enrich: Boolean = false)(sqlContext: SQLContext) extends BaseRelation with TableScan with Serializable with Product
Author: Jörn Franke <zuinnote@gmail.com>
Author: Jörn Franke <zuinnote@gmail.com>
Defines the schema of a BitcoinBlock for Spark SQL
-
class
DefaultSource extends RelationProvider
Author: Jörn Franke <zuinnote@gmail.com>
Author: Jörn Franke <zuinnote@gmail.com>
Defines a Spark data source for Bitcoin Blockchcain based on hadoopcryptoledgerlibrary. This is read-only for existing data. It returns BitcoinBlocks.
-
class
DefaultSource15 extends DefaultSource with DataSourceRegister
Author: Jörn Franke <zuinnote@gmail.com> Extension of DefaultSource (which is Spark 1.3 and 1.4 compatible) for Spark 1.5 compatibility.
Author: Jörn Franke <zuinnote@gmail.com> Extension of DefaultSource (which is Spark 1.3 and 1.4 compatible) for Spark 1.5 compatibility. Since the class is loaded through META-INF/services we can decouple the two to have Spark 1.5 byte-code loaded lazily.
This trick is adapted from spark elasticsearch-hadoop data source: <https://github.com/elastic/elasticsearch-hadoop>