Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
0.6.1
-
Kerberos HDFS
Description
Hadoop Kerberos has a way of accessing things as an authenticated user
UserGroupInformation.doAs
NIFI is doing that to get access to the filesystem in order to basically tell hadoop to use the correct credentials so our processor does that correctly and then passes the results into the sequence reader unfortunately, the sequence reader then throws away our authenticated filesystem and creates its own without wrapping in a UGI.doAs
More context:
The constructor used for org.apache.hadoop.io.SequenceFile.Reader in both KeyValueReader and ValueReader is deprecated and has been turned into a callthrough that only uses the passed in FileSystem to get the qualified path[1]. I've modified those classes to do that logic and then wrapped the callsite in the processor in a UGI.doAs if it is configured to use a UGI
Attachments
Issue Links
- is related to
-
NIFI-1128 GetHDFSSequenceFile fails with some secure hdfs configurations
- Open
- links to