org.apache.flink.streaming.connectors.kafka.internals

类 KafkaTopicPartitionAssigner

java.lang.Object

org.apache.flink.streaming.connectors.kafka.internals.KafkaTopicPartitionAssigner

@Internal
public class KafkaTopicPartitionAssigner
extends Object

Utility for assigning Kafka partitions to consumer subtasks.

构造器概要

构造器

构造器和说明
KafkaTopicPartitionAssigner()

方法概要

限定符和类型	方法和说明
static int	assign(KafkaTopicPartition partition, int numParallelSubtasks) Returns the index of the target subtask that a specific Kafka partition should be assigned to.
static int	assign(String topic, int partition, int numParallelSubtasks)

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

KafkaTopicPartitionAssigner

public KafkaTopicPartitionAssigner()

方法详细资料

assign

public static int assign(KafkaTopicPartition partition,
                         int numParallelSubtasks)

Returns the index of the target subtask that a specific Kafka partition should be assigned to.

The resulting distribution of partitions of a single topic has the following contract:

• 1. Uniformly distributed across subtasks
• 2. Partitions are round-robin distributed (strictly clockwise w.r.t. ascending subtask indices) by using the partition id as the offset from a starting index (i.e., the index of the subtask which partition 0 of the topic will be assigned to, determined using the topic name).

The above contract is crucial and cannot be broken. Consumer subtasks rely on this contract to locally filter out partitions that it should not subscribe to, guaranteeing that all partitions of a single topic will always be assigned to some subtask in a uniformly distributed manner.

参数:

partition - the Kafka partition

numParallelSubtasks - total number of parallel subtasks

返回:

index of the target subtask that the Kafka partition should be assigned to.

assign

public static int assign(String topic,
                         int partition,
                         int numParallelSubtasks)