[CASSANDRA-16360] CRC32 is inefficient on x86 - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Patch Available
Priority: Normal
Resolution: Unresolved
Fix Version/s: 5.x
Component/s: Messaging/Client, Messaging/Internode
Labels:
- protocolv6

Change Category:
Semantic
Complexity:
Challenging
Platform:

All
Test and Documentation Plan:

Hide

Run CI, the native protocol specification will need to be updated afterwards.

Show
Run CI, the native protocol specification will need to be updated afterwards.

Description

The client/server protocol specifies CRC24 and CRC32 as the checksum algorithm (cql_protocol_V5_framing.asc). Those however are expensive to compute; this affects both the client and the server.

A better checksum algorithm is CRC32C, which has hardware support on x86 (as well as other modern architectures).

Attachments

Issue Links

is related to

CASSANDRA-18780 ConnectionBurnTest fails with NullPointerException

Patch Available

CASSANDRA-13908 Add JDK9 new CRC32C checksum

Open

HADOOP-15033 Use java.util.zip.CRC32C for Java 9 and above

Resolved

CASSANDRA-16645 Add a microbenchmark for checksum calculation

Resolved

links to

GitHub Pull Request #2647

HARDWARE INSTRUCTION BASED CRC32C

(1 links to)

Activity

People

Assignee:: Maxim Muzafarov

Reporter:: Avi Kivity

Authors:: Maxim Muzafarov

Votes:: 1 Vote for this issue

Watchers:: 11 Start watching this issue

Dates

Created:: 17/Dec/20 10:19

Updated:: 20/Oct/23 13:00

Time Tracking

Estimated:

Not Specified

Remaining:

Logged:

40m