Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15679

ShutdownHookManager shutdown time needs to be configurable & extended

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.8.0, 3.0.0
    • 2.9.2, 3.0.4, 3.1.2, 2.8.6
    • util
    • None

    Description

      HADOOP-12950 added a timeout on shutdowns to avoid problems with hanging shutdowns. But the timeout is too short for applications where a large flush of data is needed on shutdown.

      A key example of this is Spark apps which save their history to object stores, where the file close() call triggers an upload of the final local cached block of data (could be 32+MB), and then execute the final mutipart commit.

      Proposed

      1. make the default sleep time 30s, not 10s
      2. make it configurable with a time duration property (with minimum time of 1s.?)

      Attachments

        1. HADOOP-15679-001.patch
          24 kB
          Steve Loughran
        2. HADOOP-15679-002.patch
          27 kB
          Steve Loughran
        3. HADOOP-15679-002.patch
          27 kB
          Steve Loughran
        4. HADOOP-15679-003.patch
          26 kB
          Steve Loughran
        5. HADOOP-15679-branch-2.8-005.patch
          27 kB
          Steve Loughran
        6. HADOOP-15679-branch-2.8-005.patch
          27 kB
          Steve Loughran
        7. HADOOP-15679-branch-2-001.patch
          26 kB
          Steve Loughran
        8. HADOOP-15679-branch-2-001.patch
          26 kB
          Steve Loughran
        9. HADOOP-15679-branch-2-003.patch
          26 kB
          Steve Loughran
        10. HADOOP-15679-branch-2-003.patch
          26 kB
          Steve Loughran
        11. HADOOP-15679-branch-2-004.patch
          26 kB
          Steve Loughran
        12. HADOOP-15679-branch-2-004.patch
          26 kB
          Steve Loughran

        Issue Links

          is caused by

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-12950 ShutdownHookManager should have a timeout for each of the Registered shutdown hook

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-16341 ShutDownHookManager: Regressed performance on Hook removals after HADOOP-15679

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-16461 Regression: FileSystem cache lock parses XML within the lock

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-24523 InterruptedException when closing SparkContext

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. SPARK-25183 Spark HiveServer2 registers shutdown hook with JVM, not ShutdownHookManager; race conditions can arise

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              stevel@apache.org Steve Loughran
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: