Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-19442 Unaligned checkpoints 1.1
  3. FLINK-19681

Passively timeout alignment on the inputs

    XMLWordPrintableJSON

Details

    Description

      CheckpointBarrierHandler will be aware of the aligned checkpoint barrier announcement messages. Based on that, it can implement basic timeout. When arriving aligned checkpoint barrier (or it's announcement) exceeded maximum allowed `checkpointStartDelay`, it should switch to unaligned checkpoint.

      This, for the time being could be done without registering any timeout action, but a passive/static check when processing checkpoint barrier/barrier announcement. If `checkpointStartDelay` is below threshold, do nothing. If above, switch to unaligned checkpoint.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-20488 Show checkpoint type in the UI (AC/UC) for each subtask

          • Major - Major loss of function.
          • Closed
          causes

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-21131 Show alignment timeout in checkpoint configuration (web UI)

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue FLINK-19682 Actively timeout checkpoint barriers on the inputs

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-20097 Race conditions in InputChannel.ChannelStatePersister

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link GitHub Pull Request #13827

          Web Link GitHub Pull Request #14057

          Activity

            People

              pnowojski Piotr Nowojski
              pnowojski Piotr Nowojski
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: