Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9618

Add thread which detects JVM pauses

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 2.3.0
    • util
    • None

    Description

      Often times users struggle to understand what happened when a long JVM pause (GC or otherwise) causes things to malfunction inside a Hadoop daemon. For example, a long GC pause while logging an edit to the QJM may cause the edit to timeout, or a long GC pause may make other IPCs to the NameNode timeout. We should add a simple thread which loops on 1-second sleeps, and if the sleep ever takes significantly longer than 1 second, log a WARN. This will make GC pauses obvious in logs.

      Attachments

        1. hadoop-9618.txt
          10 kB
          Todd Lipcon

        Issue Links

          relates to

          New Feature - A new feature of the product, which has yet to be developed. HBASE-9630 Add thread which detects JVM pauses like HADOOP's

          • Major - Major loss of function.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6443 Add JvmPauseMonitor to Job History Server

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-4019 Add JvmPauseMonitor to ResourceManager and NodeManager

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. YARN-4031 Add JvmPauseMonitor to ApplicationHistoryServer and WebAppProxyServer

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. OOZIE-1826 Add thread which detects JVM pauses

          • Major - Major loss of function.
          • Closed

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              28 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: