Details

    • Reviewed

    Description

      Prior to the heterogeneous storage feature, each Datanode had a single storage ID which was generated by the Namenode on first registration. The storage ID used fixed Datanode identifiers like IP address and port, so that in a federated cluster, for example, all NameNodes would generate the same storage ID.

      With Heterogeneous storage, we have replaced the storage ID with a per-datanode identifier called the Datanode-UUID. The Datanode UUID is also assigned by a NameNode on first registration. In a federated cluster with multiple namenodes, there are two ways to ensure a unique Datanode UUID allocation:

      1. Synchronize initial registration requests from the BPServiceActors. If a Datanode UUID is already assigned we don't need to synchronize.
      2. The datanode assigns itself a UUID on initialization.

      Attachments

        1. h5448.01.patch
          3 kB
          Arpit Agarwal
        2. h5448.03.patch
          4 kB
          Arpit Agarwal
        3. h5448.04.patch
          4 kB
          Arpit Agarwal
        4. h5448.04.addendum.patch
          0.8 kB
          Arpit Agarwal

        Activity

          People

            arp Arpit Agarwal
            arp Arpit Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: