Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
1.3.0
Description
HDDS-7208 purported to solve this. But when I use BasicRootedOzoneFileSystem.listLocatedStatus (via a FileSystemUtil::listLocatedStatusIterator) to search for a file recursively in Impala, I get back a FileStatus without the EC flag set.
The FileStatus path is ofs://localhost:9862/impala/test-warehouse/alltypes/year=2009/month=1/090101.txt, and
$ ozone sh key info impala/test-warehouse/alltypes/year=2009/month=1/090101.txt
{
"volumeName" : "impala",
"bucketName" : "test-warehouse",
"name" : "alltypes/year=2009/month=1/090101.txt",
"dataSize" : 20433,
"creationTime" : "2022-12-07T18:13:34.358Z",
"modificationTime" : "2022-12-07T18:13:34.400Z",
"replicationConfig" : {
"data" : 3,
"parity" : 2,
"ecChunkSize" : 1048576,
"codec" : "RS",
"replicationType" : "EC",
"requiredNodes" : 5
},
"ozoneKeyLocations" : [ {
"containerID" : 3,
"localID" : 109611004723200015,
"length" : 20433,
"offset" : 0,
"keyOffset" : 0
} ],
"metadata" : { },
"fileEncryptionInfo" : {...}
}
It looks like https://github.com/apache/ozone/blob/master/hadoop-ozone/ozonefs-common/src/main/java/org/apache/hadoop/fs/ozone/BasicRootedOzoneFileSystem.java#L1334-L1346 is missing the updates applied in HDDS-7208.
Attachments
Issue Links
- is depended upon by
-
IMPALA-11476 Support for Ozone with Erasure Coding
-
- Resolved
-
- relates to
-
HDDS-7208 Erasure coding and encryption are not flagged on FileStatus
-
- Resolved
-
- links to