Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
3.3.2, 3.6.1
-
None
-
None
Description
The deletion thread will not work on partition after cancel alter intra broker log dir task
The steps to reproduce are as follows:
1、Create reassignment.json file
test01-1 on the /data01/kafka/log01 directory of the broker 1003,then move to /data01/kafka/log02
{ "version": 1, "partitions": [ { "topic": "test01", "partition": 1, "replicas": [1001,1003], "log_dirs": ["any","/data01/kafka/log02"] } ] }
2、Kick off the reassignment
bin/kafka-reassign-partitions.sh -bootstrap-server localhost:9092 --reassignment-json-file reassignment.json -execute
3、Cancel the reassignment
bin/kafka-reassign-partitions.sh -bootstrap-server localhost:9092 --reassignment-json-file reassignment.json -cancel
4、Result, The partition test01-1 on 1003 will not be deleted
The reason for this problem is the partition has been filtered:
val deletableLogs = logs.filter { case (_, log) => !log.config.compact // pick non-compacted logs }.filterNot { case (topicPartition, _) => inProgress.contains(topicPartition) // skip any logs already in-progress }
Attachments
Issue Links
- links to