Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13738

DiskChecker should perform some disk IO

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha2, 2.8.5
    • None
    • None
    • Reviewed

    Description

      DiskChecker can fail to detect total disk/controller failures indefinitely. We have seen this in real clusters. DiskChecker performs simple permissions-based checks on directories which do not guarantee that any disk IO will be attempted.

      A simple improvement is to write some data and flush it to the disk.

      Attachments

        1. HADOOP-13738-branch-2.8-06.patch
          17 kB
          Vinayakumar B
        2. HADOOP-13738.05.patch
          16 kB
          Arpit Agarwal
        3. HADOOP-13738.04.patch
          16 kB
          Arpit Agarwal
        4. HADOOP-13738.03.patch
          12 kB
          Arpit Agarwal
        5. HADOOP-13738.02.patch
          11 kB
          Arpit Agarwal
        6. HADOOP-13738.01.patch
          10 kB
          Arpit Agarwal

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-15450 Avoid fsync storm triggered by DiskChecker and handle disk full situation

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-13737 Cleanup DiskChecker interface

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              arp Arpit Agarwal
              arp Arpit Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: