Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3446

FutureAction should expose the job ID

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.2.0
    • Spark Core
    • None

    Description

      This is a follow up to SPARK-2636.

      The patch for that bug added a jobId method to SimpleFutureAction. The problem is that SimpleFutureAction is not exposed through any existing API; all the AsyncRDDActions methods return just FutureAction. So clients have to restore to casting / isInstanceOf to be able to use that.

      Exposing the jobId through FutureAction has extra complications, though, because ComplexFutureAction also extends that class.

      Attachments

        Issue Links

          is depended upon by

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. SPARK-3145 Hive on Spark umbrella

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #2337 [Github] Pull Request #2337 (vanzin)

          Activity

            People

              vanzin Marcelo Masiero Vanzin
              vanzin Marcelo Masiero Vanzin
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: