Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8193

Python PostCommit Tests are Flaky

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • Not applicable
    • sdk-py-core, testing
    • None

    Description

      I will use this as an umbrella bug, create sub task and assign to folks working on Python in general. I will try to do a round-robin assignment.

      The goal is to improve stability of Py2, 3.5, 3.6, 3.7 postcommits to be working >80% of the time [1].

      /cc (you might get issues assigned) pabloem udim chamikara tvalentyn

      [1] http://104.154.241.245/d/McTAiu0ik/stability-critical-jobs-status?orgId=1

      Attachments

        1.
        		 virtualSetupEnv task is flaky Sub-task Resolved Valentyn Tymofieiev  
        2.
        		 Quota exceeded for create requests Sub-task Resolved Yifan Zou  
        3.
        		 Python Post Commit 3.6 issue Sub-task Resolved Chad Dombrova  
        4.
        		 Python 3.{5,7} post commit timed out at 100 minutes Sub-task Resolved Valentyn Tymofieiev

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        5.
        		 test_big_query_write_without_schema might be flaky? Sub-task Resolved Pablo Estrada  
        6.
        		 Python pre-commits need to include python 3.x tests Sub-task Resolved Valentyn Tymofieiev  
        7.
        		 Run Portable_Python PreCommit fails with pickling Sub-task Resolved Valentyn Tymofieiev  
        8.
        		 Use persistent caching with pip Sub-task Open Unassigned  
        9.
        		 Py2 post-commit test crossLanguagePortableWordCount failing Sub-task Resolved Chamikara Madhusanka Jayalath

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 2h
        10.
        		 ZipFileArtifactServiceTest.test_concurrent_requests flaky Sub-task Resolved Robert Bradshaw

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 2h 10m
        11.
        		 docker-credential-gcloud missing Sub-task Resolved Unassigned  
        12.
        		 test_streaming_pipeline_returns_expected_user_metrics_fnapi_it test flaky Sub-task Resolved Valentyn Tymofieiev  
        13.
        		 installGcpTest task is flaky Sub-task Resolved Udi Meiri  
        14.
        		 Consistently timing out: BigQueryStreamingInsertTransformIntegrationTests.test_multiple_destinations_transform Sub-task Resolved Pablo Estrada

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 2h 20m
        15.
        		 BigQueryQueryToTableIT.test_big_query_legacy_sql - fails in post commit tests Sub-task Resolved Unassigned  
        16.
        		 portableWordCount Flink/Spark - flaky post commits Sub-task Resolved Kyle Weaver

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        17.
        		 sparkValidatesRunner - python post commit flaky Sub-task Resolved Kyle Weaver  
        18.
        		 BigQueryWriteIntegrationTests.test_big_query_write_without_schema - flaky post commit Sub-task Resolved Chamikara Madhusanka Jayalath  
        19.
        		 beam_PostCommit_Py_VR_Dataflow is timing out Sub-task Resolved Valentyn Tymofieiev

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 40m
        20.
        		 PreCommit_Python2_PVR_Flink_Commit flaky Sub-task Resolved Kyle Weaver

        100%
        Original Estimate - Not Specified Original Estimate - Not Specified
        Time Spent - 1h 40m
        21.
        		 beam_PostCommit_Py_ValCont should run with dataflow_worker_jar Sub-task Open Unassigned  

        Activity

          People

            Unassigned Unassigned
            altay Ahmet Altay
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 10h 10m
                10h 10m