Details
-
Bug
-
Status: Resolved
-
Normal
-
Resolution: Fixed
-
None
-
Correctness - Consistency
-
Normal
-
Normal
-
User Report
-
All
-
None
-
Description
User Yorick reported on ASF Slack that a node which failed to bootstrap is stuck in hibernate status and persists in gossipinfo:
/10.x.x.108 generation:1625493756 heartbeat:86 STATUS:2:hibernate,true LOAD:79:96124.0 SCHEMA:14:59adb24e-f3cd-3e02-97f0-5b395827453f DC:10:DC1 RACK:12:RAC3 RELEASE_VERSION:6:3.11.10 INTERNAL_IP:8:10.x.x.108 RPC_ADDRESS:5:10.x.x.108 NET_VERSION:3:11 HOST_ID:4:5b254d51-fc58-4ca2-856f-fe7878752131 TOKENS:1:<hidden>
Attempts to assassinate the node returns IndexOutOfBoundsException:
ERROR [GossipStage:1] 2021-08-11 09:10:03,440 CassandraDaemon.java:244 - Exception in thread Thread[GossipStage:1,5,main]
java.lang.IndexOutOfBoundsException: Index: 0, Size: 0
at java.util.ArrayList.rangeCheck(ArrayList.java:659) ~[na:1.8.0_292]
at java.util.ArrayList.get(ArrayList.java:435) ~[na:1.8.0_292]
at com.google.common.collect.Iterables.get(Iterables.java:728) ~[guava-18.0.jar:na]
at org.apache.cassandra.gms.VersionedValue$VersionedValueFactory.makeTokenString(VersionedValue.java:156) ~[apache-cassandra-3.11.10.jar:3.11.10]
at org.apache.cassandra.gms.VersionedValue$VersionedValueFactory.left(VersionedValue.java:178) ~[apache-cassandra-3.11.10.jar:3.11.10]
at org.apache.cassandra.gms.Gossiper.lambda$assassinateEndpoint$1(Gossiper.java:695) ~[apache-cassandra-3.11.10.jar:3.11.10]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_292]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_292]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) ~[na:1.8.0_292]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [na:1.8.0_292]
at org.apache.cassandra.concurrent.NamedThreadFactory.lambda$threadLocalDeallocator$0(NamedThreadFactory.java:84) [apache-cassandra-3.11.10.jar:3.11.10]
at java.lang.Thread.run(Thread.java:748) ~[na:1.8.0_292]