[CASSANDRA-8681] cassandra-stress fails after single ReadTimeoutException - ASF JIRA

Details

Type: Bug
Status: Open
Priority: Normal
Resolution: Unresolved
Fix Version/s: None
Component/s: Legacy/Tools
Labels:
- remove-reopen
- stress

Severity:
Normal

Description

After a single exception is propagated from the Java Driver, cassandra-stress prints out some {{NoSuchElementException}}s and stops working.

Running [singlepost, timeline] with 36 threads 2 minutes
total ops , adj row/s,    op/s,    pk/s,   row/s,    mean,     med,     .95,     .99,    .999,     max,   time,   stderr,  gc: #,  max ms,  sum ms,  sdv ms,      mb
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (timeout while waiting for repair of inconsistent replica)
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (timeout while waiting for repair of inconsistent replica)
java.util.NoSuchElementException
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
java.util.NoSuchElementException
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
java.util.NoSuchElementException
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
java.util.NoSuchElementException
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (1 responses were required but only 0 replica responded)
com.datastax.driver.core.exceptions.ReadTimeoutException: Cassandra timeout during read query at consistency ONE (timeout while waiting for repair of inconsistent replica)
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.util.NoSuchElementException
java.io.IOException: Operation x10 on key(s) [Z$Vq"zj\Aw}KG2>9$TY(!">e)
                                                                       m#$D1x??]D?2S]: Error executing: (NoSuchElementException)
java.util.NoSuchElementException

java.util.NoSuchElementException
	at org.apache.cassandra.stress.Operation.error(Operation.java:211)
java.util.NoSuchElementException
	at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:183)java.util.NoSuchElementException

	at org.apache.cassandra.stress.operations.userdefined.SchemaQuery.run(SchemaQuery.java:159)java.util.NoSuchElementException
	at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:296)

java.io.IOException: Operation x10 on key(s) [ot^XJz*C{
HYUg+"'	j^36`
             KX	aj0n;]: Error executing: (NoSuchElementException)

	at org.apache.cassandra.stress.Operation.error(Operation.java:211)
	at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:183)
	at org.apache.cassandra.stress.operations.userdefined.SchemaQuery.run(SchemaQuery.java:159)
	at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:296)
java.io.IOException: Operation x10 on key(s) [\!d,*&M	D4 *^%=c MPZBZ+%W=2J
                                                                            Ic~s1/[Ba?3}V]: Error executing: (NoSuchElementException)

	at org.apache.cassandra.stress.Operation.error(Operation.java:211)
	at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:183)
	at org.apache.cassandra.stress.operations.userdefined.SchemaQuery.run(SchemaQuery.java:159)
	at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:296)
f\llVm8IMYExceptX"RCSD}:Hx~0-n x&Q on key(s) [3+`&BP0yu,sdQ!s+CYw]ILLPk v)^IJ<z`>SU-
                                  `]: Error executing: (NoSuchElementException)

	at org.apache.cassandra.stress.Operation.error(Operation.java:211)
	at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:183)
	at org.apache.cassandra.stress.operations.userdefined.SchemaQuery.run(SchemaQuery.java:159)
	at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:296)
java.io.IOException: Operation x10 on key(s) [KDIWY$$D?.+(y2iT="toY
5\.^
_dV]: Error executing: (NoSuchElementException)

	at org.apache.cassandra.stress.Operation.error(Operation.java:211)
	at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:183)
	at org.apache.cassandra.stress.operations.userdefined.SchemaQuery.run(SchemaQuery.java:159)
	at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:296)
[(>V 1]: Error executing: (NoSuchElementException)4f}n-K|.ly6q&5-/QLgu~2V{fmw5OJ;+!(v'	<T?#A$

	at org.apache.cassandra.stress.Operation.error(Operation.java:211)
	at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:183)
	at org.apache.cassandra.stress.operations.userdefined.SchemaQuery.run(SchemaQuery.java:159)
	at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:296)
java.io.IOException: Operation x10 on key(s) [$:YcLz5^?(v$aQR7b~JEjd,|]X8R><6u@P(zCTS"d0Z]: Error executing: (NoSuchElementException)

	at org.apache.cassandra.stress.Operation.error(Operation.java:211)
	at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:183)
	at org.apache.cassandra.stress.operations.userdefined.SchemaQuery.run(SchemaQuery.java:159)
	at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:296)
java.io.IOException: Operation x10 on key(s) [6-1YKka#HB2^o.g{9Mvq({	I9-I^!5S?jhNA>h#A434]: Error executing: (NoSuchElementException)

	at org.apache.cassandra.stress.Operation.error(Operation.java:211)
	at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:183)
	at org.apache.cassandra.stress.operations.userdefined.SchemaQuery.run(SchemaQuery.java:159)
	at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:296)
java.io.IOException: Operation x10 on key(s) [/aW4D-aS
                                                      lv2)fa_0I+4$
                                                                  C&]}WedM^B9D<v.\]: Error executing: (NoSuchElementException)

	at org.apache.cassandra.stress.Operation.error(Operation.java:211)
	at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:183)
	at org.apache.cassandra.stress.operations.userdefined.SchemaQuery.run(SchemaQuery.java:159)
	at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:296)
java.io.IOException: Operation x10 on key(s) [lk/!
                                                  py%
u"@$%wO4)2q]#j+1kE+0
x.8lvA}"R6}f_]: Error executing: (NoSuchElementException)

	at org.apache.cassandra.stress.Operation.error(Operation.java:211)
	at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:183)
	at org.apache.cassandra.stress.operations.userdefined.SchemaQuery.run(SchemaQuery.java:159)
	at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:296)
 $ e}*#D*T&*j Ction: Operation x10 on key(s) [
               T6{DlsMm'	u.z]: Error executing: (NoSuchElementException)

	at org.apache.cassandra.stress.Operation.error(Operation.java:211)
	at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:183)
	at org.apache.cassandra.stress.operations.userdefined.SchemaQuery.run(SchemaQuery.java:159)
	at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:296)

cassandra-stress fails after single ReadTimeoutException

Details

Description

Attachments

Activity

People

Dates