org.apache.flink.streaming.connectors.kafka.shuffle

类 FlinkKafkaShuffleConsumer<T>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.source.RichParallelSourceFunction<T>

org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase<T>

org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer<T>

org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffleConsumer<T>

所有已实现的接口:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.api.java.typeutils.ResultTypeQueryable<T>, org.apache.flink.streaming.api.checkpoint.CheckpointedFunction, org.apache.flink.streaming.api.functions.source.ParallelSourceFunction<T>, org.apache.flink.streaming.api.functions.source.SourceFunction<T>

@Internal
public class FlinkKafkaShuffleConsumer<T>
extends FlinkKafkaConsumer<T>

Flink Kafka Shuffle Consumer Function.

另请参阅:

序列化表格

嵌套类概要

从接口继承的嵌套类/接口 org.apache.flink.streaming.api.functions.source.SourceFunction

org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T>

字段概要

从类继承的字段 org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

DEFAULT_POLL_TIMEOUT, KEY_POLL_TIMEOUT, pollTimeout, properties

从类继承的字段 org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

deserializer, KEY_DISABLE_METRICS, KEY_PARTITION_DISCOVERY_INTERVAL_MILLIS, LOG, MAX_NUM_PENDING_CHECKPOINTS, PARTITION_DISCOVERY_DISABLED

方法概要

限定符和类型

方法和说明

protected AbstractFetcher<T,?>

createFetcher(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext, Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets, org.apache.flink.util.SerializedValue<org.apache.flink.api.common.eventtime.WatermarkStrategy<T>> watermarkStrategy, org.apache.flink.streaming.api.operators.StreamingRuntimeContext runtimeContext, OffsetCommitMode offsetCommitMode, org.apache.flink.metrics.MetricGroup consumerMetricGroup, boolean useMetrics) Creates the fetcher that connect to the Kafka brokers, pulls data, deserialized the data, and emits it into the data streams.

从类继承的方法 org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumer

createPartitionDiscoverer, fetchOffsetsWithTimestamp, getIsAutoCommitEnabled

从类继承的方法 org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

adjustAutoCommitConfig, assignTimestampsAndWatermarks, assignTimestampsAndWatermarks, assignTimestampsAndWatermarks, cancel, close, disableFilterRestoredPartitionsWithSubscribedTopics, getEnableCommitOnCheckpoints, getProducedType, initializeState, notifyCheckpointAborted, notifyCheckpointComplete, open, run, setCommitOffsetsOnCheckpoints, setStartFromEarliest, setStartFromGroupOffsets, setStartFromLatest, setStartFromSpecificOffsets, setStartFromTimestamp, snapshotState

从类继承的方法 org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

方法详细资料

createFetcher

protected AbstractFetcher<T,?> createFetcher(org.apache.flink.streaming.api.functions.source.SourceFunction.SourceContext<T> sourceContext,
                                             Map<KafkaTopicPartition,Long> assignedPartitionsWithInitialOffsets,
                                             org.apache.flink.util.SerializedValue<org.apache.flink.api.common.eventtime.WatermarkStrategy<T>> watermarkStrategy,
                                             org.apache.flink.streaming.api.operators.StreamingRuntimeContext runtimeContext,
                                             OffsetCommitMode offsetCommitMode,
                                             org.apache.flink.metrics.MetricGroup consumerMetricGroup,
                                             boolean useMetrics)
                                      throws Exception

从类复制的说明: FlinkKafkaConsumerBase

Creates the fetcher that connect to the Kafka brokers, pulls data, deserialized the data, and emits it into the data streams.

覆盖:

createFetcher 在类中 FlinkKafkaConsumer<T>

参数:

sourceContext - The source context to emit data to.

assignedPartitionsWithInitialOffsets - The set of partitions that this subtask should handle, with their start offsets.

watermarkStrategy - Optional, a serialized WatermarkStrategy.

runtimeContext - The task's runtime context.

返回:

The instantiated fetcher

抛出:

Exception - The method should forward exceptions