Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11339

Support File IO sampling for Datanode IO profiling hooks

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha2
    • datanode
    • None
    • Reviewed

    Description

      HDFS-10958 introduces instrumentation hooks around DataNode disk IO and HDFS-10959 adds support for profiling hooks to expose latency statistics.
      Instead of profiling all the file IO events, we can sample a fraction of the events and profile them. The fraction to be sampled can be configurable.

      Attachments

        1. HDFS-11339.003.patch
          6 kB
          Hanisha Koneru
        2. HDFS-11339.002.patch
          4 kB
          Hanisha Koneru
        3. HDFS-11339.001.patch
          5 kB
          Hanisha Koneru
        4. HDFS-11339.000.patch
          5 kB
          Hanisha Koneru

        Activity

          People

            hanishakoneru Hanisha Koneru
            hanishakoneru Hanisha Koneru
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: