Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5053

java.lang.InternalError from decompression codec cause reducer to fail

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.3-alpha, 0.23.5
    • 0.23.7, 2.0.4-alpha
    • None
    • None

    Description

      lz4, snappy, zlib, and lzo Decompressor's only throw java.lang.InternalError. This exception will cause the reducer to fail and bypass all of the fetch failure logic. The decompressing errors should be treated as fetch failures.

      Attachments

        1. MAPREDUCE-5053-1.patch
          6 kB
          Robert Parker
        2. MAPREDUCE-5053-2.patch
          6 kB
          Robert Parker
        3. MAPREDUCE-5053-b023-1.patch
          2 kB
          Robert Parker

        Issue Links

          Activity

            People

              robsparker Robert Parker
              robsparker Robert Parker
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: