Description
This issue aims to upgrade Kafka client to 2.8.0.
Note that Kafka 2.8.0 uses ZSTD JNI 1.4.9-1 like Apache Spark 3.2.0.
RELEASE NOTE
- https://downloads.apache.org/kafka/2.8.0/RELEASE_NOTES.html
- https://downloads.apache.org/kafka/2.7.0/RELEASE_NOTES.html
This will bring the latest client-side improvement and bug fixes like the following examples.
KAFKA-10631ProducerFencedException is not Handled on Offest CommitKAFKA-10134High CPU issue during rebalance in Kafka consumer after upgrading to 2.5KAFKA-12193Re-resolve IPs when a client is disconnectedKAFKA-10090Misleading warnings: The configuration was supplied but isn't a known configKAFKA-9263The new hw is added to incorrect log when ReplicaAlterLogDirsThread is replacing logKAFKA-10607Ensure the error counts contains the NONEKAFKA-10458Need a way to update quota for TokenBucket registered with SensorKAFKA-10503MockProducer doesn't throw ClassCastException when no partition for topic