Uploaded image for project: 'Apache Tez'
  1. Apache Tez
  2. TEZ-1534

Make client side configs available to AM and tasks

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.5.1
    • None
    • None

    Description

      Configs from the client (specifically the ones provided to TezClient, along with YARN additions) should be shipped over to the cluster (AM and tasks), instead of AM/tasks depending on configs present on cluster nodes.

      These configs will primarily be used for Tez components like RPC servers, clients etc - and not by the Processor / Input / Output - which should be sending over fully configured payloads in any case.

      Tez should continue to run without core-site, hdfs-site, yarn-site etc in the classpath on cluster nodes.

      Attachments

        1. TEZ-1534.3.txt
          6 kB
          Siddharth Seth
        2. TEZ-1534.2.txt
          6 kB
          Siddharth Seth
        3. TEZ-1534.1.txt
          6 kB
          Siddharth Seth

        Issue Links

          Activity

            People

              sseth Siddharth Seth
              sseth Siddharth Seth
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: