Type Members

1.  class BindingParquetOutputCommitter extends ParquetOutputCommitter with Logging

   This Parquet Committer subclass dynamically binds to the factory-configured output committer, and is intended to allow callers to use any 'PathOutputCommitter', even if not a subclass of 'ParquetOutputCommitter'.

   This Parquet Committer subclass dynamically binds to the factory-configured output committer, and is intended to allow callers to use any 'PathOutputCommitter', even if not a subclass of 'ParquetOutputCommitter'.

   The Parquet parquet.enable.summary-metadata option will only be supported if the instantiated committer itself supports it.

2.  class PathOutputCommitProtocol extends HadoopMapReduceCommitProtocol with Serializable

   Spark Commit protocol for Path Output Committers.

   Spark Commit protocol for Path Output Committers. This committer will work with the FileOutputCommitter and subclasses. All implementations *must* be serializable.

   Rather than ask the FileOutputFormat for a committer, it uses the org.apache.hadoop.mapreduce.lib.output.PathOutputCommitterFactory factory API to create the committer.

   In setupCommitter the factory is identified and instantiated; this factory then creates the actual committer implementation.