org.apache.flink.connector.base.source.reader.fetcher

类 SingleThreadFetcherManager<E,SplitT extends org.apache.flink.api.connector.source.SourceSplit>

java.lang.Object

org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager<E,SplitT>

org.apache.flink.connector.base.source.reader.fetcher.SingleThreadFetcherManager<E,SplitT>

@Internal
public class SingleThreadFetcherManager<E,SplitT extends org.apache.flink.api.connector.source.SourceSplit>
extends SplitFetcherManager<E,SplitT>

A Fetcher Manager with a single fetching thread (I/O thread) that handles all splits concurrently.

This pattern is, for example, useful for connectors like File Readers, Apache Kafka Readers, etc. In the example of Kafka, there is a single thread that reads all splits (topic partitions) via the same client. In the example of the file source, there is a single thread that reads the files after another.

字段概要

从类继承的字段 org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager

fetchers

构造器概要

构造器

构造器和说明
SingleThreadFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>> elementsQueue, java.util.function.Supplier<SplitReader<E,SplitT>> splitReaderSupplier) 已过时。 Please use SingleThreadFetcherManager(FutureCompletingBlockingQueue, Supplier, Configuration) instead.
SingleThreadFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>> elementsQueue, java.util.function.Supplier<SplitReader<E,SplitT>> splitReaderSupplier, org.apache.flink.configuration.Configuration configuration) Creates a new SplitFetcherManager with a single I/O threads.
SingleThreadFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>> elementsQueue, java.util.function.Supplier<SplitReader<E,SplitT>> splitReaderSupplier, org.apache.flink.configuration.Configuration configuration, java.util.function.Consumer<Collection<String>> splitFinishedHook) Creates a new SplitFetcherManager with a single I/O threads.

方法概要

限定符和类型	方法和说明
void	addSplits(List<SplitT> splitsToAdd)
protected SplitFetcher<E,SplitT>	getRunningFetcher()

从类继承的方法 org.apache.flink.connector.base.source.reader.fetcher.SplitFetcherManager

checkErrors, close, createSplitFetcher, getNumAliveFetchers, maybeShutdownFinishedFetchers, pauseOrResumeSplits, startFetcher

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

SingleThreadFetcherManager

@Deprecated
public SingleThreadFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>> elementsQueue,
                                              java.util.function.Supplier<SplitReader<E,SplitT>> splitReaderSupplier)

已过时。 Please use SingleThreadFetcherManager(FutureCompletingBlockingQueue, Supplier, Configuration) instead.

Creates a new SplitFetcherManager with a single I/O threads.

参数:

elementsQueue - The queue that is used to hand over data from the I/O thread (the fetchers) to the reader (which emits the records and book-keeps the state. This must be the same queue instance that is also passed to the SourceReaderBase.

splitReaderSupplier - The factory for the split reader that connects to the source system.

SingleThreadFetcherManager

public SingleThreadFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>> elementsQueue,
                                  java.util.function.Supplier<SplitReader<E,SplitT>> splitReaderSupplier,
                                  org.apache.flink.configuration.Configuration configuration)

Creates a new SplitFetcherManager with a single I/O threads.

参数:

elementsQueue - The queue that is used to hand over data from the I/O thread (the fetchers) to the reader (which emits the records and book-keeps the state. This must be the same queue instance that is also passed to the SourceReaderBase.

splitReaderSupplier - The factory for the split reader that connects to the source system.

configuration - The configuration to create the fetcher manager.

SingleThreadFetcherManager

@VisibleForTesting
public SingleThreadFetcherManager(FutureCompletingBlockingQueue<RecordsWithSplitIds<E>> elementsQueue,
                                                     java.util.function.Supplier<SplitReader<E,SplitT>> splitReaderSupplier,
                                                     org.apache.flink.configuration.Configuration configuration,
                                                     java.util.function.Consumer<Collection<String>> splitFinishedHook)

Creates a new SplitFetcherManager with a single I/O threads.

参数:

elementsQueue - The queue that is used to hand over data from the I/O thread (the fetchers) to the reader (which emits the records and book-keeps the state. This must be the same queue instance that is also passed to the SourceReaderBase.

splitReaderSupplier - The factory for the split reader that connects to the source system.

configuration - The configuration to create the fetcher manager.

splitFinishedHook - Hook for handling finished splits in split fetchers

方法详细资料

addSplits

public void addSplits(List<SplitT> splitsToAdd)

指定者:

addSplits 在类中 SplitFetcherManager<E,SplitT extends org.apache.flink.api.connector.source.SourceSplit>

getRunningFetcher

protected SplitFetcher<E,SplitT> getRunningFetcher()