Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-8970

Add more automated end-to-end tests

    XMLWordPrintableJSON

Details

    Description

      In order to improve Flink's test coverage and make releasing easier, we should add more automated end-to-end tests which test Flink more like a user would interact with the system. Additionally, these end-to-end tests should test the integration of various other systems with Flink.

      With FLINK-6539, we added a new module flink-end-to-end-tests which contains the set of currently available end-to-end tests.

      With FLINK-8911, a script was added to trigger these tests.

       

      This issue is an umbrella issue collecting all different end-to-end tests which we want to add to the Flink repository.

       

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. FLINK-8971 Create general purpose testing job

          • Critical - Crashes, loss of data, severe memory leak.
          • Closed

          Improvement - An improvement or enhancement to an existing feature or task. FLINK-8972 Create general purpose DataSet testing job

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          links to

          Web Link GitHub Pull Request #5750

          1.
          		 Introduce automated end-to-end test for local recovery (including sticky scheduling) Sub-task Closed Stefan Richter  
          2.
          		 End-to-end test: Run general purpose job with failures in standalone mode Sub-task Resolved Kostas Kloudas  
          3.
          		 End-to-end test: Run general purpose DataSet job with failures in standalone mode Sub-task Closed Tuo Wang  
          4.
          		 End-to-end test: Resume from savepoint Sub-task Closed Tzu-Li (Gordon) Tai  
          5.
          		 End-to-end test: Resume with different parallelism Sub-task Closed Tzu-Li (Gordon) Tai  
          6.
          		 End-to-end test: Quickstarts Sub-task Closed zhangminglei  
          7.
          		 End-to-end test: ElasticSearch connector Sub-task Closed zhangminglei  
          8.
          		 End-to-end test: Manually resume job after terminal failure Sub-task Closed Tzu-Li (Gordon) Tai  
          9.
          		 End-to-end test: Dynamic Kafka partition discovery Sub-task Closed Tzu-Li (Gordon) Tai  
          10.
          		 Extend Kafka end-to-end tests to run with different versions Sub-task Closed Tzu-Li (Gordon) Tai  
          11.
          		 End-to-end test: Stream SQL query with failure and retry Sub-task Resolved Fabian Hueske  
          12.
          		 End-to-end test: Job upgrade Sub-task Closed Andrey Zagrebin  
          13.
          		 End-to-end test: BucketingSink Sub-task Resolved Timo Walther  
          14.
          		 Add end-to-end test for running on YARN with Kerberos Sub-task Closed Aljoscha Krettek  
          15.
          		 End-to-end test: Queryable state Sub-task Closed Florian Schmidt  
          16.
          		 End-to-end test: Confluent schema registry Sub-task Closed Yazdan Shirvany  
          17.
          		 End-to-end test: CLI Sub-task Resolved Rong Rong  
          18.
          		 End-to-end test: REST Sub-task In Progress Unassigned  
          19.
          		 End-to-end test: Avro state evolution Sub-task Closed Kostas Kloudas  
          20.
          		 End-to-end test: Cassandra connector Sub-task Closed Unassigned  
          21.
          		 End-to-end test: Ganglia metrics reporter Sub-task Open Unassigned  
          22.
          		 Resume from savepoint end-to-end tests should be extended for different state backends Sub-task Closed Tzu-Li (Gordon) Tai  
          23.
          		 End-to-end test: Resume from retained checkpoints Sub-task Closed Tzu-Li (Gordon) Tai  
          24.
          		 End-to-end test: Add test that verifies that a specific classloading issue with avro is fixed Sub-task In Progress Unassigned  
          25.
          		 Update `test-ha.sh` end-to-end test to use general purpose DataStream job Sub-task Closed Tzu-Li (Gordon) Tai  
          26.
          		 End-to-end test: Kubernetes integration Sub-task Resolved Dawid Wysakowicz  
          27.
          		 End-to-end test: Python API Sub-task Closed Chesnay Schepler  
          28.
          		 Let externalized checkpoint resume e2e also test rescaling Sub-task Resolved Tzu-Li (Gordon) Tai  
          29.
          		 End-to-end test: Scala Quickstarts Sub-task Closed Yazdan Shirvany  
          30.
          		 End-to-end test: Flink-Example module [flink-examples-streaming] Sub-task Open Unassigned  
          31.
          		 End-to-end test: SQL Client with unified source/sink/format Sub-task Resolved Timo Walther  
          32.
          		 End-to-end test: Streaming job with SSL Sub-task Closed Nico Kruber  
          33.
          		 End-to-end test: Elasticsearch 6.x connector Sub-task Resolved Tzu-Li (Gordon) Tai  
          34.
          		 Add end-to-end test for REST communication encryption Sub-task Closed Andrey Zagrebin  
          35.
          		 Run general purpose test job with failures in per-job mode Sub-task Closed Dawid Wysakowicz  
          36.
          		 End-to-end test: Prometheus reporter Sub-task Closed Chesnay Schepler  
          37.
          		 End-to-end test: Metrics accessible via REST API Sub-task Closed Chesnay Schepler  
          38.
          		 End-to-end test: Take & resume from savepoint when using per-job mode Sub-task Closed Tzu-Li (Gordon) Tai  
          39.
          		 Add stress deployment end-to-end test Sub-task Closed Stefan Richter  
          40.
          		 Add S3 entropy injection end-to-end/IT test Sub-task Closed Gary Yao  
          41.
          		 Modify one of the s3 tests to use the Presto S3 s3p schema Sub-task Closed Stefan Richter  
          42.
          		 End-to-end test: Kinesis connector Sub-task Resolved Thomas Weise
          43.
          		 Add end2end stream sql test for unbounded operators Sub-task Open Unassigned  

          Activity

            People

              Unassigned Unassigned
              trohrmann Till Rohrmann
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m