Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-2581 Umbrella for Tez Recovery Redesign
  3. TEZ-2976

Recovery fails when InputDescriptor is changed during input initialization

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.8.2
    • 0.8.2
    • None
    • None

    Description

      2015-12-07 10:17:00,742 [main] ERROR org.apache.pig.tools.grunt.GruntParser - ERROR 2998: Unhandled internal error. Vertex failed, vertexName=scope-106, vertexId=vertex_1448526568607_13994_1_00, diagnostics=[Task failed, taskId=task_1448526568607_13994_1_00_000008, diagnostics=[TaskAttempt 0 killed, TaskAttempt 1 failed, info=[Error: Failure while running task: attempt_1448526568607_13994_1_00_000008_1:java.lang.IllegalArgumentException: Split information not expected in org.apache.tez.mapreduce.input.MRInput
      	at com.google.common.base.Preconditions.checkArgument(Preconditions.java:88)
      	at org.apache.tez.mapreduce.input.base.MRInputBase.initialize(MRInputBase.java:68)
      	at org.apache.tez.mapreduce.input.MRInput.initialize(MRInput.java:436)
      	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$InitializeInputCallable._callInternal(LogicalIOProcessorRuntimeTask.java:432)
      	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$InitializeInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:414)
      	at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask$InitializeInputCallable.callInternal(LogicalIOProcessorRuntimeTask.java:399)
      	at org.apache.tez.common.CallableWithNdc.call(CallableWithNdc.java:36)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
      	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
      	at java.lang.Thread.run(Thread.java:745)
      ],
      

      might related with PIG-4443

      Attachments

        1. TEZ-2976-1.patch
          17 kB
          Jeff Zhang
        2. TEZ-2976-2.patch
          18 kB
          Jeff Zhang

        Activity

          People

            zjffdu Jeff Zhang
            zjffdu Jeff Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: