Uploaded image for project: 'REEF (Retired)'
  1. REEF (Retired)
  2. REEF-456

Make job submission folder prefix configurable

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Implemented
    • 0.10, 0.11
    • 0.12
    • REEF Runtime YARN
    • None

    Description

      Our users want to specify job submission folder on DFS due to permission and other issues. We currently allow this with JobSubmissionDirectory named Parameter. But this causes users to deal with uniqueness issues. We should make folder prefix configurable and append job id (IE. yarn application Id) to form full path. This also makes it easier to correlate folder location with yarn app id for debugging purposes.

      Attachments

        Activity

          People

            beysims Beysim Sezgin
            beysims Beysim Sezgin
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: