Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-5764

Allow ListSftp connection parameter

    XMLWordPrintableJSON

Details

    • Wish
    • Status: Resolved
    • Critical
    • Resolution: Feedback Received
    • 1.6.0
    • None
    • Extensions

    Description

      ListSftp and other Sftp processors should be able to add parameters

      (like [-B buffer_size] [-b batchfile] [-c cipher]
      [-D sftp_server_path] [-F ssh_config] [-i identity_file] [-l limit]
      [-o ssh_option] [-P port] [-R num_requests] [-S program]
      [-s subsystem | sftp_server] host
      sftp [user@]host[:file ...]
      sftp [user@]host[:dir[/]]
      sftp -b batchfile [user@]host)

      in order to edit the type of connection on Sftp Server.

      For instance, I have this error on nifi:
      2018-10-29 11:06:09,462 ERROR [Timer-Driven Process Thread-5] SimpleProcessLogger.java:254 ListSFTP[id=766ac418-27ce-335a-5b13-52abe3495592] Failed to perform listing on remote host due to java.io.IOException: Failed to obtain connection to remote host due to com.jcraft.jsch.JSchException: Auth fail: {}
      java.io.IOException: Failed to obtain connection to remote host due to com.jcraft.jsch.JSchException: Auth fail
      at org.apache.nifi.processors.standard.util.SFTPTransfer.getChannel(SFTPTransfer.java:468)
      at org.apache.nifi.processors.standard.util.SFTPTransfer.getListing(SFTPTransfer.java:192)
      at org.apache.nifi.processors.standard.util.SFTPTransfer.getListing(SFTPTransfer.java:156)
      at org.apache.nifi.processors.standard.ListFileTransfer.performListing(ListFileTransfer.java:105)
      at org.apache.nifi.processor.util.list.AbstractListProcessor.onTrigger(AbstractListProcessor.java:401)
      at org.apache.nifi.processor.AbstractProcessor.onTrigger(AbstractProcessor.java:27)
      at org.apache.nifi.controller.StandardProcessorNode.onTrigger(StandardProcessorNode.java:1147)
      at org.apache.nifi.controller.tasks.ConnectableTask.invoke(ConnectableTask.java:175)
      at org.apache.nifi.controller.scheduling.QuartzSchedulingAgent$2.run(QuartzSchedulingAgent.java:140)
      at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
      at java.util.concurrent.FutureTask.run(FutureTask.java:266)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
      at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
      at java.lang.Thread.run(Thread.java:748)
      Caused by: com.jcraft.jsch.JSchException: Auth fail
      at com.jcraft.jsch.Session.connect(Session.java:519)
      at com.jcraft.jsch.Session.connect(Session.java:183)
      at org.apache.nifi.processors.standard.util.SFTPTransfer.getChannel(SFTPTransfer.java:448)
      ... 15 common frames omitted

      This can be avoided by connect to Sftp server with this string:
      sftp  -o “controlmaster auto” username@sftp_server

       

      Attachments

        1. dumpone
          198 kB
          dav

        Activity

          People

            Unassigned Unassigned
            dav dav
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: