org.apache.flink.streaming.connectors.kafka.partitioner

类 FlinkFixedPartitioner<T>

java.lang.Object

org.apache.flink.streaming.connectors.kafka.partitioner.FlinkKafkaPartitioner<T>

org.apache.flink.streaming.connectors.kafka.partitioner.FlinkFixedPartitioner<T>

所有已实现的接口:

Serializable

@PublicEvolving
public class FlinkFixedPartitioner<T>
extends FlinkKafkaPartitioner<T>

A partitioner ensuring that each internal Flink partition ends up in one Kafka partition.

Note, one Kafka partition can contain multiple Flink partitions.

There are a couple of cases to consider.

More Flink partitions than kafka partitions

                Flink Sinks:            Kafka Partitions
                        1       ---------------->    1
                        2   --------------/
                        3   -------------/
                        4       ------------/
 

Some (or all) kafka partitions contain the output of more than one flink partition

Fewer Flink partitions than Kafka

                Flink Sinks:            Kafka Partitions
                        1       ---------------->    1
                        2       ---------------->    2
                                                                                3
                                                                                4
                                                                                5
 

Not all Kafka partitions contain data To avoid such an unbalanced partitioning, use a round-robin kafka partitioner (note that this will cause a lot of network connections between all the Flink instances and all the Kafka brokers).

另请参阅:

序列化表格

构造器概要

构造器

构造器和说明
FlinkFixedPartitioner()

方法概要

限定符和类型	方法和说明
boolean	equals(Object o)
int	hashCode()
void	open(int parallelInstanceId, int parallelInstances) Initializer for the partitioner.
int	partition(T record, byte[] key, byte[] value, String targetTopic, int[] partitions) Determine the id of the partition that the record should be written to.

从类继承的方法 java.lang.Object

clone, finalize, getClass, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

FlinkFixedPartitioner

public FlinkFixedPartitioner()

方法详细资料

open

public void open(int parallelInstanceId,
                 int parallelInstances)

从类复制的说明: FlinkKafkaPartitioner

Initializer for the partitioner. This is called once on each parallel sink instance of the Flink Kafka producer. This method should be overridden if necessary.

覆盖:

open 在类中 FlinkKafkaPartitioner<T>

参数:

parallelInstanceId - 0-indexed id of the parallel sink instance in Flink

parallelInstances - the total number of parallel instances

partition

public int partition(T record,
                     byte[] key,
                     byte[] value,
                     String targetTopic,
                     int[] partitions)

从类复制的说明: FlinkKafkaPartitioner

Determine the id of the partition that the record should be written to.

指定者:

partition 在类中 FlinkKafkaPartitioner<T>

参数:

record - the record value

key - serialized key of the record

value - serialized value of the record

targetTopic - target topic for the record

partitions - found partitions for the target topic

返回:

the id of the target partition

equals

public boolean equals(Object o)

覆盖:

equals 在类中 Object

hashCode

public int hashCode()

覆盖:

hashCode 在类中 Object