Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9150

Making TimelineSchemaCreator support different backends for Timeline Schema Creation in ATSv2

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.10.0, 3.3.0, 2.9.3
    • ATSv2
    • None
    • Reviewed

    Description

      Currently the TimelineSchemaCreator has a concrete implementation for creating Timeline Schema's only for HBase, Hence creating this JIRA for supporting multiple back-ends that ATSv2 can support.

      Usage:

             Add the following property in yarn-site.xml

      <!-- config required for specifying the TimelineSchemaCreator class for ATSv2-->
<property>
 <name>yarn.timeline-service.schema-creator.class
 </name>
 <value>YOUR_TIMELINE_SCHEMA_CREATOR_CLASS</value> <!-- Default is org.apache.hadoop.yarn.server.timelineservice.storage.HBaseTimelineSchemaCreator-->
</property>

          The Command needed to run the TimelineSchemaCreator need not be changed i.e the below existing command can be used irrespective of the backend configured.

      bin/hadoop org.apache.hadoop.yarn.server.timelineservice.storage.TimelineSchemaCreator -create

       

       

      Attachments

        1. YARN-9150-branch-2.patch
          14 kB
          Sushil Ks
        2. YARN-9150-branch-2.004.patch
          15 kB
          Sushil Ks
        3. YARN-9150-branch-2.003.patch
          15 kB
          Sushil Ks
        4. YARN-9150-branch-2.002.patch
          0.8 kB
          Sushil Ks
        5. YARN-9150-branch-2.001.patch
          14 kB
          Sushil Ks
        6. YARN-9150.002.patch
          15 kB
          Sushil Ks
        7. YARN-9150.001.patch
          15 kB
          Sushil Ks
        8. jenkins_build.png
          491 kB
          Vrushali C

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. YARN-9016 DocumentStore as a backend for ATSv2

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Sushil-K-S Sushil Ks
              Sushil-K-S Sushil Ks
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: