Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6604

The short-circuit cache doesn't correctly time out replicas that haven't been used in a while

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 2.4.0
    • 2.5.0
    • hdfs-client
    • None

    • Centos 6.5 and distribution Hortonworks Data Platform v2.1

    • Reviewed

    Description

      When HDFS shortcircuit is enabled, the file descriptors of the deleted HDFS blocks are kept open until the cache is full. This prevents the operating system to free the space on disk.

      More details on the mailing list thread

      Attachments

        1. HDFS-6604.002.patch
          3 kB
          Colin McCabe
        2. HDFS-6604.001.patch
          0.8 kB
          Colin McCabe

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HDFS-6750 The DataNode should use its shared memory segment to mark short-circuit replicas that have been unlinked as stale

          • Major - Major loss of function.
          • Closed

          Activity

            People

              cmccabe Colin McCabe
              G.Reina Giuseppe Reina
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: