Details
-
Bug
-
Status: Resolved
-
Minor
-
Resolution: Duplicate
-
1.5.2, 1.6.0
-
None
-
None
Description
On YARN, when you run a Spark Streaming job, Spark web ui will record the Active Jobs and Completed Jobs in the http://l-hadoop-proxy-server:9981/proxy/application_XXXXXXX/jobs/ page:
but the url address for streaming batch is error. because yarn has to go through a proxy so the base uri is provided (APPLICATION_WEB_PROXY_BASE or spark.ui.proxyBase)and has to be on all links, so the right url is /proxy/application_1453101066555_1416734/streaming/batch/?id=1456370893000 not /streaming/batch/?id=1456370893000
Attachments
Issue Links
- duplicates
-
SPARK-12673 Prepending base URI of job description is missing
- Resolved