org.apache.flink.connector.base.source.utils

类 SerdeUtils

java.lang.Object

org.apache.flink.connector.base.source.utils.SerdeUtils

@Internal
public class SerdeUtils
extends Object

A util class with some helper method for serde in the sources.

方法概要

限定符和类型	方法和说明
static <SplitT extends org.apache.flink.api.connector.source.SourceSplit,C extends Collection<SplitT>> Map<Integer,C>	deserializeSplitAssignments(byte[] serialized, org.apache.flink.core.io.SimpleVersionedSerializer<SplitT> splitSerializer, java.util.function.Function<Integer,C> collectionSupplier) Deserialize the given bytes returned by serializeSplitAssignments(Map, SimpleVersionedSerializer).
static <SplitT extends org.apache.flink.api.connector.source.SourceSplit,C extends Collection<SplitT>> byte[]	serializeSplitAssignments(Map<Integer,C> splitAssignments, org.apache.flink.core.io.SimpleVersionedSerializer<SplitT> splitSerializer) Serialize a mapping from subtask ids to lists of assigned splits.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

方法详细资料

serializeSplitAssignments

public static <SplitT extends org.apache.flink.api.connector.source.SourceSplit,C extends Collection<SplitT>> byte[] serializeSplitAssignments(Map<Integer,C> splitAssignments,
                                                                                                                                               org.apache.flink.core.io.SimpleVersionedSerializer<SplitT> splitSerializer)
                                                                                                                                        throws IOException

Serialize a mapping from subtask ids to lists of assigned splits. The serialized format is following:

 4 bytes - number of subtasks
 4 bytes - split serializer version
 N bytes - [assignment_for_subtask]
                4 bytes - subtask id
                4 bytes - number of assigned splits
                N bytes - [assigned_splits]
                        4 bytes - serialized split length
                        N bytes - serialized splits
 

类型参数:

SplitT - the type of the splits.

C - the type of the collection to hold the assigned splits for a subtask.

参数:

splitAssignments - a mapping from subtask ids to lists of assigned splits.

splitSerializer - the serializer of the split.

返回:

the serialized bytes of the given subtask to splits assignment mapping.

抛出:

IOException - when serialization failed.

deserializeSplitAssignments

public static <SplitT extends org.apache.flink.api.connector.source.SourceSplit,C extends Collection<SplitT>> Map<Integer,C> deserializeSplitAssignments(byte[] serialized,
                                                                                                                                                         org.apache.flink.core.io.SimpleVersionedSerializer<SplitT> splitSerializer,
                                                                                                                                                         java.util.function.Function<Integer,C> collectionSupplier)
                                                                                                                                                  throws IOException

Deserialize the given bytes returned by serializeSplitAssignments(Map, SimpleVersionedSerializer).

类型参数:

SplitT - the type of the splits.

C - the type of the collection to hold the assigned splits for a subtask.

参数:

serialized - the serialized bytes returned by serializeSplitAssignments(Map, SimpleVersionedSerializer).

splitSerializer - the split serializer for the splits.

collectionSupplier - the supplier for the Collection instance to hold the assigned splits for a subtask.

返回:

A mapping from subtask id to its assigned splits.

抛出:

IOException - when deserialization failed.