Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-20202

Add profiler endpoint to HS2 and LLAP

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.2.0, 4.0.0
    • 3.2.0, 4.0.0-alpha-1
    • None
    • None

    Description

      Add a web endpoint for profiling based on async-profiler. This servlet should be added to httpserver so that HS2 and LLAP daemons can output flamegraphs when their /prof endpoint is hit. Since this will be based on https://github.com/jvm-profiling-tools/async-profiler heap allocation, lock contentions, HW counters etc. will also be supported in addition to cpu profiling. In most cases the profiling overhead is pretty low and is safe to run on production. More analysis on CPU and memory overhead here https://github.com/jvm-profiling-tools/async-profiler/issues/14 and https://github.com/jvm-profiling-tools/async-profiler/issues/131 

       

      For the impatient, here is the usage doc and the sample output https://github.com/prasanthj/nightswatch/blob/master/README.md 

      Attachments

        1. HIVE-20202.1.patch
          14 kB
          Prasanth Jayachandran
        2. HIVE-20202.2.patch
          14 kB
          Prasanth Jayachandran
        3. HIVE-20202.3.patch
          18 kB
          Prasanth Jayachandran
        4. HIVE-20202.4.patch
          18 kB
          Prasanth Jayachandran
        5. HIVE-20202.5.patch
          19 kB
          Prasanth Jayachandran
        6. HIVE-20202.6.patch
          21 kB
          Prasanth Jayachandran
        7. HIVE-20202.7.patch
          21 kB
          Prasanth Jayachandran
        8. HIVE-20202.8.patch
          21 kB
          Prasanth Jayachandran
        9. HIVE-20202.9.patch
          21 kB
          Prasanth Jayachandran

        Issue Links

          Activity

            People

              prasanth_j Prasanth Jayachandran
              prasanth_j Prasanth Jayachandran
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: