Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21030

Broken job restart for job with disjoint graph

    XMLWordPrintableJSON

Details

    Description

      Building on top of bugs:

      https://issues.apache.org/jira/browse/FLINK-21028

       and https://issues.apache.org/jira/browse/FLINK-21029 :

      I tried to stop a Flink application on YARN via savepoint which didn't succeed due to a possible bug/racecondition in shutdown (Bug 21028). Due to some reason, Flink attempted to restart the pipeline after the failure in shutdown (21029). The bug here:

      As I mentioned: My jobgraph is disjoint and the pipelines are fully isolated. Lets say the original error occured in a single task of pipeline1. Flink then restarted the entire pipeline1, but pipeline2 was shutdown successfully and switched the state to FINISHED.

      My job thus was in kind of an invalid state after the attempt to stopping: One of two pipelines was running, the other was FINISHED. I guess this is kind of a bug in the restarting behavior that only all connected components of a graph are restarted, but the others aren't...

      Attachments

        Issue Links

          Activity

            People

              mapohl Matthias Pohl
              TheoD Theo Diefenthal
              Votes:
              0 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: