Details
-
Improvement
-
Status: Closed
-
Minor
-
Resolution: Fixed
-
0.13.0
-
None
-
None
-
Reviewed
Description
The HPath class makes 2 separate calls to FileSystem#getFileStatus to get the block size and replication. In the case of HDFS, this results in 2 separate but identical RPC transactions with the NameNode. The situation is the same for many other alternative FileSystem implementations too. We can get a minor latency improvement and lighten some RPC load on the remote services by using a single call and getting the block size and replication from the same response.
Attachments
Attachments
Issue Links
- is depended upon by
-
HADOOP-13525 Optimize uses of FS operations in the ASF analysis frameworks and libraries
- Resolved
- is related to
-
HADOOP-13321 Deprecate FileSystem APIs that promote inefficient call patterns.
- Resolved