Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
As part of KUDU-1097 we changed the replica move tool to use the new 3-4-3 re-replication scheme when it's enabled. In certain edge-case scenarios, such as when there is a replica failure in the middle of a move operation, the reliability of the tool may be reduced, and the node slated for removal may not be removed. This is especially true if the user hits ctrl+c and kills the tool before the movement process is complete in the context of a simultaneous failure.
We can improve this by implementing leadership transfer (KUDU-2245) and having a leader gracefully step down when there is a suitable replacement and the leader is marked with the "replace=true" attribute in the Raft config.