Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-9177

[C++][Parquet] Tracking issue for cross-implementation LZ4 Parquet compression compatibility

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • None
    • 2.0.0
    • C++

    Description

      per PARQUET-1878, it seems that there are still problems with our use of LZ4 compression in the Parquet format. While we should fix this (the Parquet specification and our implementation of it), we may need to disable use of LZ4 compression until the appropriate compatibility testing can bed one.

      Attachments

        Issue Links

          fixes

          Improvement - An improvement or enhancement to an existing feature or task. PARQUET-1878 [C++] lz4 codec is not compatible with Hadoop Lz4Codec

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. PARQUET-2196 Support LZ4_RAW codec

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. ARROW-11301 [C++] Fix reading LZ4-compressed Parquet files produced by Java Parquet implementation

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link GitHub Pull Request #16

          Web Link GitHub Pull Request #9244

          Activity

            People

              apitrou Antoine Pitrou
              wesm Wes McKinney
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 2h 40m
                  2h 40m