Details
-
Epic
-
Status: Resolved
-
Critical
-
Resolution: Fixed
-
2.7.0
-
None
-
BE: Support Name Federation in Ambari
Description
We are pulling in Name Node federation support in HDFS/HDP 3.0, requires Ambari support for NN Federation.
Details
======
What NN federation allows is to share the Data Nodes between a set of independent Name Nodes. Each NN has its own standby and has the meta-data pointing to the blocks in the data nodes, however, they might share the Data Nodes. This will let us scale to 250M files for each NN and add more NNs as we go beyond 250M files.
Ambari support will be required to make sure we can manage and configure NN federation.