Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-26450

FileStateHandle.discardState does not process return value

    XMLWordPrintableJSON

Details

    Description

      The retryable cleanup does not work properly if there's an error appearing during the FileSystem.delete call which is used within FileStateHandle.discardState. Some FileSystem implementations (e.g. S3 presto; see PrestoS3FileSystem:512 through PrestoS3FileSystem.delete(Path, boolean)) return false in case of an error which will be swallowed in FileStateHandle.discardState.

      Attachments

        Issue Links

          Discovered while testing

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-26388 Release Testing: Repeatable Cleanup (FLINK-25433)

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          is caused by

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-4910 Introduce safety net for closing file system streams

          • Major - Major loss of function.
          • Resolved
          is fixed by

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-25484 TableRollingPolicy do not support inactivityInterval config which is supported in datastream api

          • Major - Major loss of function.
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. FLINK-26488 FileSystem.listFiles is not implemented consistently

          • Major - Major loss of function.
          • Open

          Bug - A problem which impairs or prevents the functions of the product. FLINK-26484 FileSystem.delete is not implemented consistently

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link GitHub Pull Request #18963

          Activity

            People

              mapohl Matthias Pohl
              mapohl Matthias Pohl
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: