Uploaded image for project: 'Apache Knox'
  1. Apache Knox
  2. KNOX-1744

[Spark History UI Service] Executor logs (stdout/stderr) links are broken

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.2.0, 1.3.0
    • 1.4.0
    • None
    • None

    Description

      The executor logs (stdout/stderr) links from the Yarn UI Service all directly points to the slaves nodes.

      Eg. the link:

      http://emr-slave-hostname:8042/node/containerlogs/container_1547901130703_0034_01_000001/hadoop/stdout?start=-4096

      Should have been instead: 

      https://knox/gateway/cluster/yarn/nodemanager/node/containerlogs/container_1547901130703_0034_01_000001/hadoop?scheme=http&host=emr-slave-hostname&port=8042

      And finally respect pattern:

      https://knox/gateway/emr/yarn/nodemanager/node/containerlogs/{your container id}/hadoop?scheme=http&host={executor host}&port=8042 

      I guess adding some voodoo in the Knox yarnui's rewrite.xml file might be enough to fix this.

      Attachments

        1. image-2019-01-22-13-11-55-412.png
          92 kB
          Nicolas Colomer
        2. image-2019-01-22-13-04-53-935.png
          322 kB
          Nicolas Colomer

        Issue Links

          Activity

            People

              ankur.gupta Ankur Gupta
              ncolomer Nicolas Colomer
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h