Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-9911

ListHDFS fails when HDFS URI in Directory property does not contain the host:port part

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.14.0, 1.15.0, 1.16.0, 1.15.1, 1.15.2, 1.15.3
    • 1.17.0, 1.16.1
    • Extensions
    • None

    Description

      The scheme and authority (host:port) part of the HDFS URI comes from the core-site.xml but it is also possible to specify a full HDFS URI (e.g. hdfs://myhost:9000/path/to/dir) in the Directory property in ListHDFS (instead of simply /path/to/dir).

      NIFI-8737 introduced a warning message when the HDFS URI specified in the Directory property does not match the URI in core-site.xml. However, this validation logic does not handle URIs having a scheme but no authority part properly and results in NPE.

      Attachments

        Issue Links

          Activity

            People

              turcsanyip Peter Turcsanyi
              turcsanyip Peter Turcsanyi
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h