Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-9910

Slow ozone hdfs performance when lots of config files

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0
    • None

    Description

      The ozone hdfs interface spends a lot of time unnecessarily reading config files.  On our cluster, (as shown in the flame graph below,) 90% of the time of a rename is spent reading config files unnecessarily.

      The fix is just to read them once when the hdfs is created, and reuse them there after.

      I'll post the fix soon.

      Attachments

        1. sparkRenameFlamegraph.png
          304 kB
          George Jahad

        Issue Links

          Activity

            People

              georgeJahad George Jahad
              georgeJahad George Jahad
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: