Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1223 Shuffle errors at 10 TB scale
  3. TEZ-1226

Shuffle - Encoded byte size mismatch exception

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      2014-06-22 21:17:15,146 WARN fetcher [Reducer_9] #397 org.apache.tez.runtime.library.common.shuffle.impl.Fetcher: Invalid map id
      java.lang.IllegalArgumentException: Encoded byte size for String was -30, which is outside of 0..1000 range.
      at org.apache.hadoop.io.WritableUtils.readStringSafely(WritableUtils.java:477)
      at org.apache.tez.runtime.library.common.shuffle.impl.ShuffleHeader.readFields(ShuffleHeader.java:82)
      at org.apache.tez.runtime.library.common.shuffle.impl.Fetcher.copyMapOutput(Fetcher.java:325)
      at org.apache.tez.runtime.library.common.shuffle.impl.Fetcher.copyFromHost(Fetcher.java:270)
      at org.apache.tez.runtime.library.common.shuffle.impl.Fetcher.run(Fetcher.java:137)

      Attachments

        Activity

          People

            rajesh.balamohan Rajesh Balamohan
            rajesh.balamohan Rajesh Balamohan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: