Uploaded image for project: 'Oozie'
  1. Oozie
  2. OOZIE-1146

FileSystem used by prepare sections should use the configuration of the action

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 3.2.0, 3.2.1
    • 4.0.0
    • action, workflow
    • Oozie 3.2.2, Hadoop cdh3u3

    Description

      We should be able to propagate configurations to prepare section (delete, mkdir) of action in workflow xmls.
      Though the configuration section is available per action, it is not available in for prepare tags:

      A simple use-case is to support custom filesystem by configuring the filesystem impl class in configuration, but delete prepare action is not aware of configuration set in action xml.

      Ex:<action name="myfirstHadoopJob">
      <map-reduce>
      <job-tracker>foo:9001</job-tracker>
      <name-node>bar:9000</name-node>
      <prepare>
      <delete path="hdfs://foo:9000/usr/tucu/output-data"/>
      </prepare>
      <job-xml>/myfirstjob.xml</job-xml>
      <configuration>
      <property><name>fs.s4.impl</name><value>org.apache.grid.fs.s4fs.NativeS4FileSystem</value></property>
      .....

      I think this can be fixed in FileSystemsActions.java

      Attachments

        1. OOZIE-1146-1.patch
          5 kB
          Rohini Palaniswamy
        2. OOZIE-1146-1-branch4.patch
          5 kB
          Rohini Palaniswamy

        Issue Links

          Activity

            People

              rohini Rohini Palaniswamy
              shaik.idris Shaik Idris Ali
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 72h
                  72h
                  Remaining:
                  Remaining Estimate - 72h
                  72h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified