Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8193 Python PostCommit Tests are Flaky
  3. BEAM-8867

sparkValidatesRunner - python post commit flaky

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • P1
    • Resolution: Fixed
    • None
    • Not applicable
    • runner-spark

    Description

      Logs: https://scans.gradle.com/s/iwdvlnwg6euhk/console-log?task=:sdks:python:test-suites:portable:py2:sparkValidatesRunner

       

      Error:

      ERROR org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService: Failed to remove job staging directory for token {"sessionId":"job_79e29409-03c8-4203-bac4-ca3c30f00b35","basePath":"/tmp/sparktestzSz0RX"}: {} ERROR org.apache.beam.runners.fnexecution.jobsubmission.InMemoryJobService: Failed to remove job staging directory for token {"sessionId":"job_79e29409-03c8-4203-bac4-ca3c30f00b35","basePath":"/tmp/sparktestzSz0RX"}: {} java.io.FileNotFoundException: /tmp/sparktestzSz0RX/job_79e29409-03c8-4203-bac4-ca3c30f00b35/MANIFEST (No such file or directory)

      Attachments

        Issue Links

          duplicates

          Bug - A problem which impairs or prevents the functions of the product. BEAM-8870 beam_PostCommit_Python_VR_Spark is permanently failing

          • P1 - Critical bug: data loss, total loss of function, or loss of testing signal due to test failures or flakiness
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-8883 downgrade "Failed to remove job staging directory" log level

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved

          Activity

            People

              ibzib Kyle Weaver
              altay Ahmet Altay
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: