Details
-
New Feature
-
Status: Resolved
-
Major
-
Resolution: Implemented
-
0.10, 0.11
-
None
Description
Our users want to specify job submission folder on DFS due to permission and other issues. We currently allow this with JobSubmissionDirectory named Parameter. But this causes users to deal with uniqueness issues. We should make folder prefix configurable and append job id (IE. yarn application Id) to form full path. This also makes it easier to correlate folder location with yarn app id for debugging purposes.