org.apache.flink.streaming.connectors.kafka.internals

类 TransactionalIdsGenerator

java.lang.Object

org.apache.flink.streaming.connectors.kafka.internals.TransactionalIdsGenerator

@Internal
public class TransactionalIdsGenerator
extends Object

Class responsible for generating transactional ids to use when communicating with Kafka.

It guarantees that:

• generated ids to use will never clash with ids to use from different subtasks
• generated ids to abort will never clash with ids to abort from different subtasks
• generated ids to use will never clash with ids to abort from different subtasks

In other words, any particular generated id will always be assigned to one and only one subtask.

构造器概要

构造器

构造器和说明
TransactionalIdsGenerator(String prefix, int subtaskIndex, int totalNumberOfSubtasks, int poolSize, int safeScaleDownFactor)

方法概要

限定符和类型	方法和说明
Set<String>	generateIdsToAbort() If we have to abort previous transactional id in case of restart after a failure BEFORE first checkpoint completed, we don't know what was the parallelism used in previous attempt.
Set<String>	generateIdsToUse(long nextFreeTransactionalId) Range of available transactional ids to use is: [nextFreeTransactionalId, nextFreeTransactionalId + parallelism * kafkaProducersPoolSize) loop below picks in a deterministic way a subrange of those available transactional ids based on index of this subtask.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

TransactionalIdsGenerator

public TransactionalIdsGenerator(String prefix,
                                 int subtaskIndex,
                                 int totalNumberOfSubtasks,
                                 int poolSize,
                                 int safeScaleDownFactor)

方法详细资料

generateIdsToUse

public Set<String> generateIdsToUse(long nextFreeTransactionalId)

Range of available transactional ids to use is: [nextFreeTransactionalId, nextFreeTransactionalId + parallelism * kafkaProducersPoolSize) loop below picks in a deterministic way a subrange of those available transactional ids based on index of this subtask.

generateIdsToAbort

public Set<String> generateIdsToAbort()

If we have to abort previous transactional id in case of restart after a failure BEFORE first checkpoint completed, we don't know what was the parallelism used in previous attempt. In that case we must guess the ids range to abort based on current configured pool size, current parallelism and safeScaleDownFactor.