Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-25827

Potential memory leaks in SourceOperator

    XMLWordPrintableJSON

Details

    Description

      SourceOperator.SourceOperatorAvailabilityHelper is prone to the same type of memory leak as FLINK-25728. Every time new CompletableFuture.any is created:

                      currentCombinedFuture =
                        CompletableFuture.anyOf(forcedStopFuture, sourceReaderFuture);
                return currentCombinedFuture;

      Such future is never garbage collected, because forcedStopFuture will keep a reference to it. This will eventually lead to a memory leak, or force stopping might take very long time to complete.

      Attachments

        Issue Links

          is related to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-24300 MultipleInputOperator is running much more slowly in TPCDS

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed

          Bug - A problem which impairs or prevents the functions of the product. FLINK-25728 Potential memory leaks in StreamMultipleInputProcessor

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed
          links to

          Web Link GitHub Pull Request #18575

          Activity

            People

              pnowojski Piotr Nowojski
              pnowojski Piotr Nowojski
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: