org.apache.flink.streaming.connectors.kafka

接口 KafkaDeserializationSchema<T>

类型参数:

T - The type created by the keyed deserialization schema.

所有超级接口:

org.apache.flink.api.java.typeutils.ResultTypeQueryable<T>, Serializable

所有已知子接口:

KeyedDeserializationSchema<T>

所有已知实现类:

JSONKeyValueDeserializationSchema, KafkaDeserializationSchemaWrapper, TypeInformationKeyValueSerializationSchema

@PublicEvolving
public interface KafkaDeserializationSchema<T>
extends Serializable, org.apache.flink.api.java.typeutils.ResultTypeQueryable<T>

The deserialization schema describes how to turn the Kafka ConsumerRecords into data types (Java/Scala objects) that are processed by Flink.

方法概要

限定符和类型	方法和说明
T	deserialize(org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]> record) Deserializes the Kafka record.
default void	deserialize(org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]> message, org.apache.flink.util.Collector<T> out) Deserializes the Kafka record.
boolean	isEndOfStream(T nextElement) Method to decide whether the element signals the end of the stream.
default void	open(org.apache.flink.api.common.serialization.DeserializationSchema.InitializationContext context) Initialization method for the schema.

从接口继承的方法 org.apache.flink.api.java.typeutils.ResultTypeQueryable

getProducedType

方法详细资料

open

default void open(org.apache.flink.api.common.serialization.DeserializationSchema.InitializationContext context)
           throws Exception

Initialization method for the schema. It is called before the actual working methods deserialize(org.apache.kafka.clients.consumer.ConsumerRecord<byte[], byte[]>) and thus suitable for one time setup work.

The provided DeserializationSchema.InitializationContext can be used to access additional features such as e.g. registering user metrics.

参数:

context - Contextual information that can be used during initialization.

抛出:

Exception

isEndOfStream

boolean isEndOfStream(T nextElement)

Method to decide whether the element signals the end of the stream. If true is returned the element won't be emitted.

参数:

nextElement - The element to test for the end-of-stream signal.

返回:

True, if the element signals end of stream, false otherwise.

deserialize

T deserialize(org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]> record)
       throws Exception

Deserializes the Kafka record.

参数:

record - Kafka record to be deserialized.

返回:

The deserialized message as an object (null if the message cannot be deserialized).

抛出:

Exception

deserialize

default void deserialize(org.apache.kafka.clients.consumer.ConsumerRecord<byte[],byte[]> message,
                         org.apache.flink.util.Collector<T> out)
                  throws Exception

Deserializes the Kafka record.

Can output multiple records through the Collector. Note that number and size of the produced records should be relatively small. Depending on the source implementation records can be buffered in memory or collecting records might delay emitting checkpoint barrier.

参数:

message - The message, as a byte array.

out - The collector to put the resulting messages.

抛出:

Exception