org.apache.flink.connector.kafka.source

类 KafkaSource<OUT>

java.lang.Object

org.apache.flink.connector.kafka.source.KafkaSource<OUT>

类型参数:

OUT - the output type of the source.

所有已实现的接口:

Serializable, org.apache.flink.api.connector.source.Source<OUT,KafkaPartitionSplit,KafkaSourceEnumState>, org.apache.flink.api.connector.source.SourceReaderFactory<OUT,KafkaPartitionSplit>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<OUT>

@PublicEvolving
public class KafkaSource<OUT>
extends Object
implements org.apache.flink.api.connector.source.Source<OUT,KafkaPartitionSplit,KafkaSourceEnumState>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<OUT>

The Source implementation of Kafka. Please use a KafkaSourceBuilder to construct a KafkaSource. The following example shows how to create a KafkaSource emitting records of String type.

 KafkaSource<String> source = KafkaSource
     .<String>builder()
     .setBootstrapServers(KafkaSourceTestEnv.brokerConnectionStrings)
     .setGroupId("MyGroup")
     .setTopics(Arrays.asList(TOPIC1, TOPIC2))
     .setDeserializer(new TestingKafkaRecordDeserializationSchema())
     .setStartingOffsets(OffsetsInitializer.earliest())
     .build();
 

KafkaSourceEnumerator only supports adding new splits and not removing splits in split discovery.

See KafkaSourceBuilder for more details on how to configure this source.

另请参阅:

序列化表格

方法概要

限定符和类型	方法和说明
static <OUT> KafkaSourceBuilder<OUT>	builder() Get a kafkaSourceBuilder to build a KafkaSource.
org.apache.flink.api.connector.source.SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState>	createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<KafkaPartitionSplit> enumContext)
org.apache.flink.api.connector.source.SourceReader<OUT,KafkaPartitionSplit>	createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
org.apache.flink.api.connector.source.Boundedness	getBoundedness()
org.apache.flink.core.io.SimpleVersionedSerializer<KafkaSourceEnumState>	getEnumeratorCheckpointSerializer()
org.apache.flink.api.common.typeinfo.TypeInformation<OUT>	getProducedType()
org.apache.flink.core.io.SimpleVersionedSerializer<KafkaPartitionSplit>	getSplitSerializer()
org.apache.flink.api.connector.source.SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState>	restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<KafkaPartitionSplit> enumContext, KafkaSourceEnumState checkpoint)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

方法详细资料

builder

public static <OUT> KafkaSourceBuilder<OUT> builder()

Get a kafkaSourceBuilder to build a KafkaSource.

返回:

a Kafka source builder.

getBoundedness

public org.apache.flink.api.connector.source.Boundedness getBoundedness()

指定者:

getBoundedness 在接口中 org.apache.flink.api.connector.source.Source<OUT,KafkaPartitionSplit,KafkaSourceEnumState>

createReader

@Internal
public org.apache.flink.api.connector.source.SourceReader<OUT,KafkaPartitionSplit> createReader(org.apache.flink.api.connector.source.SourceReaderContext readerContext)
                                                                                                   throws Exception

指定者:

createReader 在接口中 org.apache.flink.api.connector.source.SourceReaderFactory<OUT,KafkaPartitionSplit>

抛出:

Exception

createEnumerator

@Internal
public org.apache.flink.api.connector.source.SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState> createEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<KafkaPartitionSplit> enumContext)

指定者:

createEnumerator 在接口中 org.apache.flink.api.connector.source.Source<OUT,KafkaPartitionSplit,KafkaSourceEnumState>

restoreEnumerator

@Internal
public org.apache.flink.api.connector.source.SplitEnumerator<KafkaPartitionSplit,KafkaSourceEnumState> restoreEnumerator(org.apache.flink.api.connector.source.SplitEnumeratorContext<KafkaPartitionSplit> enumContext,
                                                                                                                                   KafkaSourceEnumState checkpoint)
                                                                                                                            throws IOException

指定者:

restoreEnumerator 在接口中 org.apache.flink.api.connector.source.Source<OUT,KafkaPartitionSplit,KafkaSourceEnumState>

抛出:

IOException

getSplitSerializer

@Internal
public org.apache.flink.core.io.SimpleVersionedSerializer<KafkaPartitionSplit> getSplitSerializer()

指定者:

getSplitSerializer 在接口中 org.apache.flink.api.connector.source.Source<OUT,KafkaPartitionSplit,KafkaSourceEnumState>

getEnumeratorCheckpointSerializer

@Internal
public org.apache.flink.core.io.SimpleVersionedSerializer<KafkaSourceEnumState> getEnumeratorCheckpointSerializer()

指定者:

getEnumeratorCheckpointSerializer 在接口中 org.apache.flink.api.connector.source.Source<OUT,KafkaPartitionSplit,KafkaSourceEnumState>

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<OUT> getProducedType()

指定者:

getProducedType 在接口中 org.apache.flink.api.java.typeutils.ResultTypeQueryable<OUT>