Uploaded image for project: 'Apache Knox'
  1. Apache Knox
  2. KNOX-2647

[Spark History UI Service] Executor logs (stdout/stderr) links are broken with JobHostory Service

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 1.5.0
    • 1.6.0
    • None
    • None

    Description

      Currently with Knox 1.5.0 on a cluster with both Spark History Server and MR JobHistory Server running the stdout and stderr links target the MR JobHistory Server Web UI directly. For us this breaks them because we require Knox fronted proxy access to the MR JobHistory Server on our production cluster.

      A similar issue was raised in:

      However in this case the links are going to the MR JobHistory Server not YARN RM so the targets are different and the previous rewrites do not apply.

      Attachments

        1. spark-history-ui.png
          323 kB
          Xiao Yu
        2. KNOX-2647.patch
          2 kB
          Xiao Yu

        Issue Links

          Activity

            People

              xyu Xiao Yu
              xyu Xiao Yu
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m