Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-18656

Start Delay metric is always zero for unaligned checkpoints and source tasks

    XMLWordPrintableJSON

Details

    Description

      As visible in the attached screenshot, start delay is 0, despite very high end to end time and very quick async/sync times. This is impossible, as "start delay" should be equal to "end_to_end_time - sync_time - async_time".

      The bug is probably in CheckpointBarrierUnaligner class, which seems to never invoke CheckpointBarrierHandler#markCheckpointStart.

      It's important to make sure this metric is also set for source tasks (time to acquire checkpoint lock).

      Attachments

        1. Screenshot 2020-07-21 at 09.58.29.png
          53 kB
          Piotr Nowojski
        2. Screenshot 2020-07-21 at 09.53.21.png
          55 kB
          Piotr Nowojski

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-15603 Show checkpoint start delay in checkpoint statistics

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-22833 Source tasks (both old and new) are not reporting checkpoint start delay via CheckpointMetrics

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-18662 Provide more detailed metrics why unaligned checkpoint is taking long time

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          links to

          Web Link GitHub Pull Request #12989

          Web Link GitHub Pull Request #13008

          Activity

            People

              pnowojski Piotr Nowojski
              pnowojski Piotr Nowojski
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: