Details
Description
When the stress test runs with high concurrency on the EC2 cluster, sometimes queries fail with the following error message. This was observed in cases where we run only select queries and in cases where we also run CRUD queries.
status.cc:114] Unable to open scanner: Timed out: Client connection negotiation failed: client connection to 172.28.195.167:7050: Timeout exceeded waiting to connect: Timed out: Client connection negotiation failed: client connection to 172.28.194.188:7050: Timeout exceeded waiting to connect @ 0x11b3ba1 (unknown) @ 0x17d5de7 (unknown) @ 0x1771308 (unknown) @ 0x1771726 (unknown) @ 0x1773646 (unknown) @ 0x177350c (unknown) @ 0x177308d (unknown) @ 0x1772ec3 (unknown) @ 0x132d4f4 (unknown) @ 0x15d6273 (unknown) @ 0x15dd24c (unknown) @ 0x15dd18f (unknown) @ 0x15dd0ea (unknown) @ 0x1a2518a (unknown) @ 0x7faf323299d1 (unknown) @ 0x7faf320768fd (unknown) runtime-state.cc:208] Error from query 554b52e24918e84c:9be6b9c900000000: Unable to open scanner: Timed out: Client connection negotiation failed: client connection to 172.28.195.167:7050: Timeout exceeded waiting to connect: Timed out: Client connection negotiation failed: client connection to 172.28.194.188:7050: Timeout exceeded waiting to connect