Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7076

Broker startup could be inefficient when using old message format

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.11.0.0, 0.11.0.1, 0.11.0.2, 1.0.0, 1.0.1, 1.1.0
    • 2.0.0
    • core
    • None

    Description

      During broker startup, we call `Log#recoverSegment` when we find corrupted indexes, for segments beyond the last check-pointed recovery point, and for any ".swap" segments created by log cleaner. One of the things `Log#recoverSegments` does is to build up the producer state, starting from any previous snapshot file that is available. For logs using message formats older than V2, we could skip building up this producer state which would essentially speed up recovery.

      Attachments

        Issue Links

          Activity

            People

              dhruvilshah Dhruvil Shah
              dhruvilshah Dhruvil Shah
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: