Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-15418

Update statement on decompression location

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 3.7.0
    • docs

    Description

      The docs state]: 

       "Kafka supports this with an efficient batching format. A batch of messages can be clumped together compressed and sent to the server in this form. This batch of messages will be written in compressed form and will
         remain compressed in the log and will only be decompressed by the consumer."

      However, brokers always perform some amount of batch decompression in order to validate data. Internally, the LogValidator class implements the validation logic, and message decompression ultimately happens in the relevant CompressionType's wrapForInput implementation. These lines need updating to reflect that, including the scenarios that require full payload decompression on the broker (compacted topic, or topic level compression codec different from producer's codec). 

       

       

      Attachments

        Issue Links

          Activity

            People

              Cerchie Lucia Cerchie
              Cerchie Lucia Cerchie
              Matthias J. Sax Matthias J. Sax
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 24h
                  24h
                  Remaining:
                  Remaining Estimate - 24h
                  24h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified