Uploaded image for project: 'StreamPipes'
  1. StreamPipes
  2. STREAMPIPES-321

Fail to stop pipeline if one of the PE is stopped manually/not running

    XMLWordPrintableJSON

Details

    Description

      I have identified a problem with the following use case.

      Use case:

      1) Run a pipeline with two flink PE's.

      2) Go to flink dashboard and cancel one of the flink job (i.e. PE)

      3) Go to streampipes UI and try to stop the pipeline.

      4) It fails to stop the pipeline completely because of the missing PE.

      5) The other PE's are stopped now, but the pipeline is still shown as running.

       

      Expected behaviour:

      If the flink job is not found, then it means that it is cancelled or failed. So streampipes should continue to stop this PE from its in-memory storage and mark the whole pipeline as Stopped.

       

      See the attached screenshots!

       
      Right now, I see two approaches: # Put the line 141 (https://github.com/apache/incubator-streampipes/blob/2f10a17b77a93eee48527e4e88baf[…]streampipes/container/api/InvocablePipelineElementResource.java) inside a try/catch block, and execute line 144 in any case.

      1. Or, make a change in FlinkRuntime.java (https://github.com/apache/incubator-streampipes/blob/2f10a17b77a93eee48527e4e88baf[…]ain/java/org/apache/streampipes/wrapper/flink/FlinkRuntime.java) in method discardRuntime() to also check if its present and its state is running then cancel the job, else check if its status is CANCELLED or FAILED, then return and don't throw exception. Otherwise throw exception.

       

       

      Attachments

        1. zx2.png
          348 kB
          Muhammad Faizan
        2. zx1.png
          92 kB
          Muhammad Faizan

        Issue Links

          Activity

            People

              wiener Patrick Wiener
              faizan-d Muhammad Faizan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: