Details
-
New Feature
-
Status: Patch Available
-
Major
-
Resolution: Unresolved
-
3.2.0, 2.9.2, 3.0.3, 3.1.2
-
None
-
None
Description
Open this JIRA to discuss if we should move MetadataStore in S3Guard into a common module.
Based on this work, other filesystem or object store can implement their own metastore for optimization (known issues like consistency problem and metadata operation performance). stevel@apache.org and other guys have done many base and great works in S3Guard. It is very helpful to start work. I did some perf test in HADOOP-14098, and started related work for Aliyun OSS. Indeed there are still works to do for S3Guard, like metadata cache inconsistent with S3 and so on. It also will be a problem for other object store. However, we can do these works in parallel.
stevel@apache.org fabbri drankye Any suggestion is appreciated.
Attachments
Attachments
Issue Links
- is depended upon by
-
HADOOP-12876 [Azure Data Lake] Support for process level FileStatus cache to optimize GetFileStatus frequent operations
- Resolved
- is related to
-
HADOOP-14098 AliyunOSS: improve the performance of object metadata operation
- In Progress