Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1015

Dag failed with Invalid event: V_ROUTE_EVENT at RECOVERING

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.4.0
    • 0.5.0, 0.4.1
    • None
    • None

    Description

      During HA tests hive job was run where NN was killed in the background and RM was also killed once. The job failed with

      2014-04-03 08:59:03,253 ERROR [AsyncDispatcher event handler] org.apache.tez.dag.app.dag.impl.VertexImpl: Can't handle Invalid event V_ROUTE_EVENT on vertex Reducer 8 with vertexId vertex_1396515360091_0001_1_03 at current state RECOVERING
      org.apache.hadoop.yarn.state.InvalidStateTransitonException: Invalid event: V_ROUTE_EVENT at RECOVERING
      	at org.apache.hadoop.yarn.state.StateMachineFactory.doTransition(StateMachineFactory.java:305)
      	at org.apache.hadoop.yarn.state.StateMachineFactory.access$300(StateMachineFactory.java:46)
      	at org.apache.hadoop.yarn.state.StateMachineFactory$InternalStateMachine.doTransition(StateMachineFactory.java:448)
      	at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:1210)
      	at org.apache.tez.dag.app.dag.impl.VertexImpl.handle(VertexImpl.java:156)
      	at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1659)
      	at org.apache.tez.dag.app.DAGAppMaster$VertexEventDispatcher.handle(DAGAppMaster.java:1645)
      	at org.apache.hadoop.yarn.event.AsyncDispatcher.dispatch(AsyncDispatcher.java:173)
      	at org.apache.hadoop.yarn.event.AsyncDispatcher$1.run(AsyncDispatcher.java:106)
      	at java.lang.Thread.run(Thread.java:662)
      

      Attachments

        1. TEZ-1015.3.patch
          13 kB
          Hitesh Shah
        2. TEZ-1015.2.patch
          13 kB
          Hitesh Shah
        3. TEZ-1015.1.patch
          13 kB
          Hitesh Shah

        Issue Links

          Activity

            People

              Unassigned Unassigned
              arpitgupta Arpit Gupta
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: