KafkaSink (Flink : Connectors : Kafka 1.17.1 API)

java.lang.Object
- org.apache.flink.connector.kafka.sink.KafkaSink<IN>

类型参数:

IN - type of the records written to Kafka

所有已实现的接口:

Serializable, org.apache.flink.api.connector.sink2.Sink<IN>, org.apache.flink.api.connector.sink2.StatefulSink<IN,org.apache.flink.connector.kafka.sink.KafkaWriterState>, org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink<IN,org.apache.flink.connector.kafka.sink.KafkaCommittable>
```
@PublicEvolving
public class KafkaSink<IN>
extends Object
implements org.apache.flink.api.connector.sink2.StatefulSink<IN,org.apache.flink.connector.kafka.sink.KafkaWriterState>, org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink<IN,org.apache.flink.connector.kafka.sink.KafkaCommittable>
```
Flink Sink to produce data into a Kafka topic. The sink supports all delivery guarantees described by DeliveryGuarantee.
DeliveryGuarantee.NONE does not provide any guarantees: messages may be lost in case of issues on the Kafka broker and messages may be duplicated in case of a Flink failure.
DeliveryGuarantee.AT_LEAST_ONCE the sink will wait for all outstanding records in the Kafka buffers to be acknowledged by the Kafka producer on a checkpoint. No messages will be lost in case of any issue with the Kafka brokers but messages may be duplicated when Flink restarts.
DeliveryGuarantee.EXACTLY_ONCE: In this mode the KafkaSink will write all messages in a Kafka transaction that will be committed to Kafka on a checkpoint. Thus, if the consumer reads only committed data (see Kafka consumer config isolation.level), no duplicates will be seen in case of a Flink restart. However, this delays record writing effectively until a checkpoint is written, so adjust the checkpoint duration accordingly. Please ensure that you use unique transactionalIdPrefixs across your applications running on the same Kafka cluster such that multiple running jobs do not interfere in their transactions! Additionally, it is highly recommended to tweak Kafka transaction timeout (link) >> maximum checkpoint duration + maximum restart duration or data loss may happen when Kafka expires an uncommitted transaction.

另请参阅:: on how to construct a KafkaSink, 序列化表格

嵌套类概要
- 从接口继承的嵌套类/接口 org.apache.flink.api.connector.sink2.StatefulSink
  org.apache.flink.api.connector.sink2.StatefulSink.StatefulSinkWriter<InputT,WriterStateT>, org.apache.flink.api.connector.sink2.StatefulSink.WithCompatibleState
- 从接口继承的嵌套类/接口 org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink
  org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink.PrecommittingSinkWriter<InputT,CommT>
- 从接口继承的嵌套类/接口 org.apache.flink.api.connector.sink2.Sink
  org.apache.flink.api.connector.sink2.Sink.InitContext

方法概要

所有方法静态方法实例方法具体方法
限定符和类型	方法和说明
`static <IN> KafkaSinkBuilder<IN>`	`builder()` Create a `KafkaSinkBuilder` to construct a new `KafkaSink`.
`org.apache.flink.api.connector.sink2.Committer<org.apache.flink.connector.kafka.sink.KafkaCommittable>`	`createCommitter()`
`org.apache.flink.connector.kafka.sink.KafkaWriter<IN>`	`createWriter(org.apache.flink.api.connector.sink2.Sink.InitContext context)`
`org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.connector.kafka.sink.KafkaCommittable>`	`getCommittableSerializer()`
`protected Properties`	`getKafkaProducerConfig()`
`org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.connector.kafka.sink.KafkaWriterState>`	`getWriterStateSerializer()`
`org.apache.flink.connector.kafka.sink.KafkaWriter<IN>`	`restoreWriter(org.apache.flink.api.connector.sink2.Sink.InitContext context, Collection<org.apache.flink.connector.kafka.sink.KafkaWriterState> recoveredState)`

从类继承的方法 java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

方法详细资料

builder
```
public static <IN> KafkaSinkBuilder<IN> builder()
```
Create a KafkaSinkBuilder to construct a new KafkaSink.

类型参数:

IN - type of incoming records

返回:

KafkaSinkBuilder

createCommitter

@Internal
public org.apache.flink.api.connector.sink2.Committer<org.apache.flink.connector.kafka.sink.KafkaCommittable> createCommitter()
                                                                                                                                 throws IOException

指定者:: createCommitter 在接口中 org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink<IN,org.apache.flink.connector.kafka.sink.KafkaCommittable>
抛出:: IOException

getCommittableSerializer
```
@Internal
public org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.connector.kafka.sink.KafkaCommittable> getCommittableSerializer()
```
指定者:

getCommittableSerializer 在接口中 org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink<IN,org.apache.flink.connector.kafka.sink.KafkaCommittable>

createWriter
```
@Internal
public org.apache.flink.connector.kafka.sink.KafkaWriter<IN> createWriter(org.apache.flink.api.connector.sink2.Sink.InitContext context)
                                                                             throws IOException
```
指定者:

createWriter 在接口中 org.apache.flink.api.connector.sink2.Sink<IN>

指定者:

createWriter 在接口中 org.apache.flink.api.connector.sink2.StatefulSink<IN,org.apache.flink.connector.kafka.sink.KafkaWriterState>

指定者:

createWriter 在接口中 org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink<IN,org.apache.flink.connector.kafka.sink.KafkaCommittable>

抛出:

IOException

restoreWriter

@Internal
public org.apache.flink.connector.kafka.sink.KafkaWriter<IN> restoreWriter(org.apache.flink.api.connector.sink2.Sink.InitContext context,
                                                                                     Collection<org.apache.flink.connector.kafka.sink.KafkaWriterState> recoveredState)
                                                                              throws IOException

指定者:: restoreWriter 在接口中 org.apache.flink.api.connector.sink2.StatefulSink<IN,org.apache.flink.connector.kafka.sink.KafkaWriterState>
抛出:: IOException

getWriterStateSerializer
```
@Internal
public org.apache.flink.core.io.SimpleVersionedSerializer<org.apache.flink.connector.kafka.sink.KafkaWriterState> getWriterStateSerializer()
```
指定者:

getWriterStateSerializer 在接口中 org.apache.flink.api.connector.sink2.StatefulSink<IN,org.apache.flink.connector.kafka.sink.KafkaWriterState>

getKafkaProducerConfig

@VisibleForTesting
protected Properties getKafkaProducerConfig()

类 KafkaSink<IN>

嵌套类概要

从接口继承的嵌套类/接口 org.apache.flink.api.connector.sink2.StatefulSink

从接口继承的嵌套类/接口 org.apache.flink.api.connector.sink2.TwoPhaseCommittingSink

从接口继承的嵌套类/接口 org.apache.flink.api.connector.sink2.Sink

方法概要

从类继承的方法 java.lang.Object

方法详细资料

builder

createCommitter

getCommittableSerializer

createWriter

restoreWriter

getWriterStateSerializer

getKafkaProducerConfig