Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-10311

In cluster mode, AppId and AttemptId should be update when ApplicationMaster is new

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.1, 1.5.0
    • 1.5.1, 1.6.0
    • DStreams
    • None

    Description

      When I start a streaming app with checkpoint data in yarn-cluster mode, the appId and attempId are old(which app first create the checkpoint data), and the event log writes into the old file name.

      Attachments

        Activity

          People

            meiyoula meiyoula
            meiyoula meiyoula
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: