Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5535 Umbrella jira for improved HDFS rolling upgrades
  3. HDFS-5583

Make DN send an OOB Ack on shutdown before restarting

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • HDFS-5535 (Rolling upgrades)
    • None
    • None
    • Reviewed

    Description

      Add an ability for data nodes to send an OOB response in order to indicate an upcoming upgrade-restart. Client should ignore the pipeline error from the node for a configured amount of time and try reconstruct the pipeline without excluding the restarted node. If the node does not come back in time, regular pipeline recovery should happen.

      This feature is useful for the applications with a need to keep blocks local. If the upgrade-restart is fast, the wait is preferable to losing locality. It could also be used in general instead of the draining-writer strategy.

      Attachments

        1. HDFS-5583.patch
          29 kB
          Kihwal Lee
        2. HDFS-5583.patch
          31 kB
          Kihwal Lee
        3. HDFS-5583.patch
          31 kB
          Kihwal Lee
        4. HDFS-5583.patch
          31 kB
          Kihwal Lee

        Issue Links

          breaks

          Sub-task - The sub-task of the issue HDFS-6014 Fix findbug warnings introduced by HDFS-5583

          • Major - Major loss of function.
          • Resolved
          depends upon

          Sub-task - The sub-task of the issue HDFS-5585 Provide admin commands for data node upgrade

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue HDFS-5924 Utilize OOB upgrade message processing for writes

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-6569 OOB message can't be sent to the client when DataNode shuts down for upgrade

          • Major - Major loss of function.
          • Closed

          Activity

            People

              kihwal Kihwal Lee
              kihwal Kihwal Lee
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: