Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8578

On upgrade, Datanode should process all storage/data dirs in parallel

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • None
    • 2.8.0, 2.7.3, 3.0.0-alpha1
    • datanode
    • None
    • Reviewed

    Description

      Right now, during upgrades datanode is processing all the storage dirs sequentially. Assume it takes ~20 mins to process a single storage dir then datanode which has ~10 disks will take around 3hours to come up.

      BlockPoolSliceStorage.java

         for (int idx = 0; idx < getNumStorageDirs(); idx++) {
      doTransition(datanode, getStorageDir(idx), nsInfo, startOpt);
      assert getCTime() == nsInfo.getCTime() 
          : "Data-node and name-node CTimes must be the same.";
    }

      It would save lots of time during major upgrades if datanode process all storagedirs/disks parallelly.

      Can we make datanode to process all storage dirs parallelly?

      Attachments

        1. HDFS-8578-branch-2.7-003.patch
          20 kB
          Vinayakumar B
        2. HDFS-8578-branch-2.7-002.patch
          38 kB
          Vinayakumar B
        3. HDFS-8578-branch-2.7-001.patch
          38 kB
          Vinayakumar B
        4. HDFS-8578-branch-2.6.0.patch
          4 kB
          Raju Bairishetti
        5. HDFS-8578-17.patch
          25 kB
          Vinayakumar B
        6. HDFS-8578-16.patch
          23 kB
          Vinayakumar B
        7. HDFS-8578-15.patch
          20 kB
          Vinayakumar B
        8. HDFS-8578-14.patch
          38 kB
          Vinayakumar B
        9. HDFS-8578-13.patch
          38 kB
          Vinayakumar B
        10. HDFS-8578-12.patch
          19 kB
          Vinayakumar B
        11. HDFS-8578-11.patch
          19 kB
          Vinayakumar B
        12. HDFS-8578-10.patch
          18 kB
          Vinayakumar B
        13. HDFS-8578-09.patch
          18 kB
          Vinayakumar B
        14. HDFS-8578-08.patch
          18 kB
          Vinayakumar B
        15. HDFS-8578-07.patch
          17 kB
          Vinayakumar B
        16. HDFS-8578-06.patch
          16 kB
          Vinayakumar B
        17. HDFS-8578-05.patch
          11 kB
          Vinayakumar B
        18. HDFS-8578-04.patch
          11 kB
          Vinayakumar B
        19. HDFS-8578-03.patch
          11 kB
          Vinayakumar B
        20. HDFS-8578-02.patch
          10 kB
          Vinayakumar B
        21. HDFS-8578-01.patch
          4 kB
          Vinayakumar B
        22. h8578_20160218-branch-2.7-addendum.patch
          2 kB
          Vinayakumar B
        23. h8578_20160218.patch
          20 kB
          Tsz-wo Sze
        24. h8578_20160216.patch
          18 kB
          Tsz-wo Sze
        25. h8578_20160128b.patch
          19 kB
          Tsz-wo Sze
        26. h8578_20160128.patch
          18 kB
          Tsz-wo Sze
        27. h8578_20160117.patch
          51 kB
          Tsz-wo Sze
        28. h8578_20151213.patch
          50 kB
          Tsz-wo Sze
        29. h8578_20151212.patch
          50 kB
          Tsz-wo Sze
        30. h8578_20151211b.patch
          46 kB
          Tsz-wo Sze
        31. h8578_20151211.patch
          43 kB
          Tsz-wo Sze
        32. h8578_20151210.patch
          41 kB
          Tsz-wo Sze

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. HDFS-8791 block ID-based DN storage layout can be very slow for datanode on ext4

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-9654 Code refactoring for HDFS-8578

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          duplicates

          Bug - A problem which impairs or prevents the functions of the product. HDFS-8782 Upgrade to block ID-based DN storage layout delays DN registration

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-9536 OOM errors during parallel upgrade to Block-ID based layout

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-8782 Upgrade to block ID-based DN storage layout delays DN registration

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              vinayakumarb Vinayakumar B
              raju.bairishetti Raju Bairishetti
              Votes:
              0 Vote for this issue
              Watchers:
              33 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: