[HADOOP-14169] Implement listStatusIterator, listLocatedStatus for ViewFs - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Minor
Resolution: Fixed
Affects Version/s: 2.6.5
Fix Version/s: 2.9.0, 2.7.4, 3.0.0-alpha4, 2.8.2
Component/s: viewfs
Labels:
None

Target Version/s:

2.7.4
Hadoop Flags:

Reviewed

Description

Similar to what ~~HADOOP-11812~~ did for ViewFileSystem, currently ViewFs does not respect optimizations to listStatusIterator or listLocatedStatus, using the naive implementations within AbstractFileSystem. This can cause performance issues if iterating over a large directory, especially if the locations are also needed. This can be easily fixed.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HADOOP-14169.002.patch
10/Mar/17 21:06
12 kB
Erik Krogen
HADOOP-14169.001.patch
10/Mar/17 19:44
12 kB
Erik Krogen
HADOOP-14169.000.patch
10/Mar/17 18:58
12 kB
Erik Krogen

Issue Links

is related to

HADOOP-11812 Implement listLocatedStatus for ViewFileSystem to speed up split calculation

Closed

Activity

People

Assignee:: Erik Krogen

Reporter:: Erik Krogen

Votes:: 0 Vote for this issue

Watchers:: 8 Start watching this issue

Dates

Created:: 10/Mar/17 01:15

Updated:: 08/Jun/17 00:09

Resolved:: 18/Mar/17 00:49