Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1223 Shuffle errors at 10 TB scale
  3. TEZ-1224

Shuffle - Integer overflow exception

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      java.io.IOException: value too long to fit in integer
      at org.apache.hadoop.io.WritableUtils.readVInt(WritableUtils.java:331)
      at org.apache.tez.runtime.library.common.shuffle.impl.ShuffleHeader.readFields(ShuffleHeader.java:85)
      at org.apache.tez.runtime.library.common.shuffle.impl.Fetcher.copyMapOutput(Fetcher.java:325)
      at org.apache.tez.runtime.library.common.shuffle.impl.Fetcher.copyFromHost(Fetcher.java:270)
      at org.apache.tez.runtime.library.common.shuffle.impl.Fetcher.run(Fetcher.java:137)

      Attachments

        Activity

          People

            rajesh.balamohan Rajesh Balamohan
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: