org.apache.flink.streaming.connectors.kafka.shuffle

类 FlinkKafkaShuffleProducer<IN,KEY>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.sink.RichSinkFunction<IN>

org.apache.flink.streaming.api.functions.sink.TwoPhaseCommitSinkFunction<IN,FlinkKafkaProducer.KafkaTransactionState,FlinkKafkaProducer.KafkaTransactionContext>

org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer<IN>

org.apache.flink.streaming.connectors.kafka.shuffle.FlinkKafkaShuffleProducer<IN,KEY>

所有已实现的接口:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.api.common.state.CheckpointListener, org.apache.flink.streaming.api.checkpoint.CheckpointedFunction, org.apache.flink.streaming.api.functions.sink.SinkFunction<IN>

@Internal
public class FlinkKafkaShuffleProducer<IN,KEY>
extends FlinkKafkaProducer<IN>

Flink Kafka Shuffle Producer Function. It is different from FlinkKafkaProducer in the way handling elements and watermarks

另请参阅:

序列化表格

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	FlinkKafkaShuffleProducer.KafkaSerializer<IN> Flink Kafka Shuffle Serializer.

从类继承的嵌套类/接口 org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

FlinkKafkaProducer.ContextStateSerializer, FlinkKafkaProducer.KafkaTransactionContext, FlinkKafkaProducer.KafkaTransactionState, FlinkKafkaProducer.NextTransactionalIdHint, FlinkKafkaProducer.NextTransactionalIdHintSerializer, FlinkKafkaProducer.Semantic, FlinkKafkaProducer.TransactionStateSerializer

从类继承的嵌套类/接口 org.apache.flink.streaming.api.functions.sink.TwoPhaseCommitSinkFunction

org.apache.flink.streaming.api.functions.sink.TwoPhaseCommitSinkFunction.State<TXN,CONTEXT>, org.apache.flink.streaming.api.functions.sink.TwoPhaseCommitSinkFunction.StateSerializer<TXN,CONTEXT>, org.apache.flink.streaming.api.functions.sink.TwoPhaseCommitSinkFunction.StateSerializerSnapshot<TXN,CONTEXT>, org.apache.flink.streaming.api.functions.sink.TwoPhaseCommitSinkFunction.TransactionHolder<TXN>

从接口继承的嵌套类/接口 org.apache.flink.streaming.api.functions.sink.SinkFunction

org.apache.flink.streaming.api.functions.sink.SinkFunction.Context

字段概要

从类继承的字段 org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

asyncException, callback, DEFAULT_KAFKA_PRODUCERS_POOL_SIZE, DEFAULT_KAFKA_TRANSACTION_TIMEOUT, defaultTopicId, KEY_DISABLE_METRICS, pendingRecords, producerConfig, SAFE_SCALE_DOWN_FACTOR, semantic, topicPartitionsMap, writeTimestampToKafka

从类继承的字段 org.apache.flink.streaming.api.functions.sink.TwoPhaseCommitSinkFunction

pendingCommitTransactions, state, userContext

方法概要

限定符和类型	方法和说明
void	invoke(FlinkKafkaProducer.KafkaTransactionState transaction, IN next, org.apache.flink.streaming.api.functions.sink.SinkFunction.Context context) This is the function invoked to handle each element.
void	invoke(org.apache.flink.streaming.api.watermark.Watermark watermark) This is the function invoked to handle each watermark.

从类继承的方法 org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer

abort, acknowledgeMessage, beginTransaction, checkErroneous, close, commit, createProducer, finishRecoveringContext, getPartitionsByTopic, getTransactionTimeout, ignoreFailuresAfterTransactionTimeout, initializeState, initializeUserContext, open, preCommit, recoverAndAbort, recoverAndCommit, setLogFailuresOnly, setTransactionalIdPrefix, setWriteTimestampToKafka, snapshotState

从类继承的方法 org.apache.flink.streaming.api.functions.sink.TwoPhaseCommitSinkFunction

currentTransaction, enableTransactionTimeoutWarnings, finish, finishProcessing, getUserContext, invoke, invoke, notifyCheckpointAborted, notifyCheckpointComplete, pendingTransactions, setTransactionTimeout

从类继承的方法 org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.functions.sink.SinkFunction

writeWatermark

方法详细资料

invoke

public void invoke(FlinkKafkaProducer.KafkaTransactionState transaction,
                   IN next,
                   org.apache.flink.streaming.api.functions.sink.SinkFunction.Context context)
            throws FlinkKafkaException

This is the function invoked to handle each element.

覆盖:

invoke 在类中 FlinkKafkaProducer<IN>

参数:

transaction - Transaction state; elements are written to Kafka in transactions to guarantee different level of data consistency

next - Element to handle

context - Context needed to handle the element

抛出:

FlinkKafkaException - for kafka error

invoke

public void invoke(org.apache.flink.streaming.api.watermark.Watermark watermark)
            throws FlinkKafkaException

This is the function invoked to handle each watermark.

参数:

watermark - Watermark to handle

抛出:

FlinkKafkaException - For kafka error