Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-24120

Document MALLOC_ARENA_MAX as workaround for glibc memory leak

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.14.0, 1.13.2
    • 1.14.0, 1.13.3
    • Documentation, flink-docker
    • flink on k8s

      flink version : 1.13.2

      state.backend: rocksdb

      state.checkpoints.dir: hdfs_url

      state.savepoints.dir: hdfs_url

      state.backend.rocksdb.memory.managed: true

       

    Description

      My task will do a savepoint every hour, so every hour will do a savepoint. From the memory monitoring, it can be seen that the memory of each hour will soar up, although the memory will drop a little later, but from every hour From the point of view of the memory peak on the whole point, the memory continues to rise little by little, and eventually rises to the limited memory, which will lead to being killed by k8S

       

       

      Attachments

        Issue Links

          Activity

            People

              wind_ljy Jiayi Liao
              593700624 no nO
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: