Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-4164

Hadoop 22 Exception thrown after task completion causes its reexecution

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.22.0
    • 0.22.1
    • tasktracker
    • None
    • Reviewed

    Description

      2012-02-28 19:17:08,504 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 1969310 bytes
      2012-02-28 19:17:08,694 INFO org.apache.hadoop.mapred.Task: Task:attempt_201202272306_0794_m_000094_0 is done. And is in the process of commiting
      2012-02-28 19:18:08,774 INFO org.apache.hadoop.mapred.Task: Communication exception: java.io.IOException: Call to /127.0.0.1:35400 failed on local exception: java.nio.channels.ClosedByInterruptException
      at org.apache.hadoop.ipc.Client.wrapException(Client.java:1094)
      at org.apache.hadoop.ipc.Client.call(Client.java:1062)
      at org.apache.hadoop.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:198)
      at $Proxy0.statusUpdate(Unknown Source)
      at org.apache.hadoop.mapred.Task$TaskReporter.run(Task.java:650)
      at java.lang.Thread.run(Thread.java:662)
      Caused by: java.nio.channels.ClosedByInterruptException
      at java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:184)
      at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:341)
      at org.apache.hadoop.net.SocketOutputStream$Writer.performIO(SocketOutputStream.java:60)
      at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
      at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:151)
      at org.apache.hadoop.net.SocketOutputStream.write(SocketOutputStream.java:112)
      at java.io.BufferedOutputStream.flushBuffer(BufferedOutputStream.java:65)
      at java.io.BufferedOutputStream.flush(BufferedOutputStream.java:123)
      at java.io.DataOutputStream.flush(DataOutputStream.java:106)
      at org.apache.hadoop.ipc.Client$Connection.sendParam(Client.java:769)
      at org.apache.hadoop.ipc.Client.call(Client.java:1040)
      ... 4 more

      2012-02-28 19:18:08,825 INFO org.apache.hadoop.mapred.Task: Task 'attempt_201202272306_0794_m_000094_0' done.

      ================>>>>>> SHOULD be <++++++++++++++
      2012-02-28 19:17:02,214 INFO org.apache.hadoop.mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 1974104 bytes
      2012-02-28 19:17:02,408 INFO org.apache.hadoop.mapred.Task: Task:attempt_201202272306_0794_m_000000_0 is done. And is in the process of commiting
      2012-02-28 19:17:02,519 INFO org.apache.hadoop.mapred.Task: Task 'attempt_201202272306_0794_m_000000_0' done.

      Attachments

        1. MAPREDUCE-4164.patch
          2 kB
          Mayank Bansal

        Activity

          People

            mayank_bansal Mayank Bansal
            mayank_bansal Mayank Bansal
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: