Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-1128

GetHDFSSequenceFile fails with some secure hdfs configurations

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 0.3.0
    • None
    • Extensions
    • None

    Description

      hdfs-site.xml snippet

          <property>
              <name>dfs.data.transfer.protection</name>
              <value>privacy</value>
          </property>
          <property>
              <name>dfs.encrypt.data.transfer</name>
              <value>true</value>
          </property>
          <property>
              <name>dfs.encrypt.data.transfer.algorithm</name>
              <value>rc4</value>
          </property>
          </property>
      

      core-site.xml snippet

          <property>
              <name>hadoop.security.authentication</name>
              <value>kerberos</value>
          </property>
             <property>
              <name>hadoop.rpc.protection</name>
              <value>privacy</value>
          </property>
      
      

      GetHDFS works with the same config. I believe the file listing may be working (as evidenced by the filename being read)

      Log messages:

      015-11-07 22:43:18,581 WARN [Timer-Driven Process Thread-8] org.apache.hadoop.ipc.Client Exception encountered while connecting to the server : javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]
      2015-11-07 22:43:18,582 ERROR [Timer-Driven Process Thread-8] o.a.n.p.hadoop.GetHDFSSequenceFile GetHDFSSequenceFile[id=9549891c-ce8f-478b-85a2-eb5bd727ce73] Error retrieving file hdfs://computer1:9000/use/seq/1ad40994-85ca-11e5-b15d-94de80cd2495.sf from HDFS due to java.io.IOException: Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; Host Details : local host is: "computer2/127.0.1.1"; destination host is: "computer1":9000; : java.io.IOException: Failed on local exception: java.io.IOException: javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)]; Host Details : local host is: "computer2/127.0.1.1"; destination host is: "computer1":9000; 
      

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              tkurc Tony Kurc
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: