org.apache.flink.connector.kafka.source.reader

类 KafkaSourceReader<T>

java.lang.Object

org.apache.flink.connector.base.source.reader.SourceReaderBase<E,T,SplitT,SplitStateT>

org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>,T,KafkaPartitionSplit,KafkaPartitionSplitState>

org.apache.flink.connector.kafka.source.reader.KafkaSourceReader<T>

所有已实现的接口:

AutoCloseable, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.connector.source.SourceReader<T,KafkaPartitionSplit>

@Internal
public class KafkaSourceReader<T>
extends org.apache.flink.connector.base.source.reader.SingleThreadMultiplexSourceReaderBase<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>,T,KafkaPartitionSplit,KafkaPartitionSplitState>

The source reader for Kafka partitions.

字段概要

从类继承的字段 org.apache.flink.connector.base.source.reader.SourceReaderBase

config, context, options, recordEmitter, splitFetcherManager

构造器概要

构造器

构造器和说明

KafkaSourceReader(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>>> elementsQueue, KafkaSourceFetcherManager kafkaSourceFetcherManager, org.apache.flink.connector.base.source.reader.RecordEmitter<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>,T,KafkaPartitionSplitState> recordEmitter, org.apache.flink.configuration.Configuration config, org.apache.flink.api.connector.source.SourceReaderContext context, KafkaSourceReaderMetrics kafkaSourceReaderMetrics)

方法概要

限定符和类型	方法和说明
protected KafkaPartitionSplitState	initializedState(KafkaPartitionSplit split)
void	notifyCheckpointComplete(long checkpointId)
protected void	onSplitFinished(Map<String,KafkaPartitionSplitState> finishedSplitIds)
void	pauseOrResumeSplits(Collection<String> splitsToPause, Collection<String> splitsToResume)
List<KafkaPartitionSplit>	snapshotState(long checkpointId)
protected KafkaPartitionSplit	toSplitType(String splitId, KafkaPartitionSplitState splitState)

从类继承的方法 org.apache.flink.connector.base.source.reader.SourceReaderBase

addSplits, close, getNumberOfCurrentlyAssignedSplits, handleSourceEvents, isAvailable, notifyNoMoreSplits, pollNext, start

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted

构造器详细资料

KafkaSourceReader

public KafkaSourceReader(org.apache.flink.connector.base.source.reader.synchronization.FutureCompletingBlockingQueue<org.apache.flink.connector.base.source.reader.RecordsWithSplitIds<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>>> elementsQueue,
                         KafkaSourceFetcherManager kafkaSourceFetcherManager,
                         org.apache.flink.connector.base.source.reader.RecordEmitter<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>,T,KafkaPartitionSplitState> recordEmitter,
                         org.apache.flink.configuration.Configuration config,
                         org.apache.flink.api.connector.source.SourceReaderContext context,
                         KafkaSourceReaderMetrics kafkaSourceReaderMetrics)

方法详细资料

onSplitFinished

protected void onSplitFinished(Map<String,KafkaPartitionSplitState> finishedSplitIds)

指定者:

onSplitFinished 在类中 org.apache.flink.connector.base.source.reader.SourceReaderBase<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>,T,KafkaPartitionSplit,KafkaPartitionSplitState>

snapshotState

public List<KafkaPartitionSplit> snapshotState(long checkpointId)

指定者:

snapshotState 在接口中 org.apache.flink.api.connector.source.SourceReader<T,KafkaPartitionSplit>

覆盖:

snapshotState 在类中 org.apache.flink.connector.base.source.reader.SourceReaderBase<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>,T,KafkaPartitionSplit,KafkaPartitionSplitState>

notifyCheckpointComplete

public void notifyCheckpointComplete(long checkpointId)
                              throws Exception

抛出:

Exception

initializedState

protected KafkaPartitionSplitState initializedState(KafkaPartitionSplit split)

指定者:

initializedState 在类中 org.apache.flink.connector.base.source.reader.SourceReaderBase<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>,T,KafkaPartitionSplit,KafkaPartitionSplitState>

toSplitType

protected KafkaPartitionSplit toSplitType(String splitId,
                                          KafkaPartitionSplitState splitState)

指定者:

toSplitType 在类中 org.apache.flink.connector.base.source.reader.SourceReaderBase<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>,T,KafkaPartitionSplit,KafkaPartitionSplitState>

pauseOrResumeSplits

public void pauseOrResumeSplits(Collection<String> splitsToPause,
                                Collection<String> splitsToResume)

指定者:

pauseOrResumeSplits 在接口中 org.apache.flink.api.connector.source.SourceReader<T,KafkaPartitionSplit>

覆盖:

pauseOrResumeSplits 在类中 org.apache.flink.connector.base.source.reader.SourceReaderBase<org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]>,T,KafkaPartitionSplit,KafkaPartitionSplitState>