Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4067

Java: FlinkPortableTestRunner: runs portably via self-started local Flink

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • P3
    • Resolution: Fixed
    • None
    • 2.7.0
    • runner-flink
    • None

    Description

      The portable Flink runner cannot be tested through the normal mechanisms used for ValidatesRunner tests because it requires a job server to be constructed out of band and for pipelines to be run through it. We should implement a shim that acts as a standard Java SDK Runner that spins up the necessary server (possibly in-process) and runs against it.

      Attachments

        Issue Links

          depends upon

          Bug - A problem which impairs or prevents the functions of the product. BEAM-4776 Java PortableRunner should support metrics

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Triage Needed

          New Feature - A new feature of the product, which has yet to be developed. BEAM-4071 Java: PortableRunner - p.run() via given JobService

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. BEAM-4130 Portable Flink runner JobService entry point in a Docker container

          • P3 - Non-urgent bugs, features, and improvements
          • Resolved
          is depended upon by

          Bug - A problem which impairs or prevents the functions of the product. BEAM-4176 Java: Portable batch runner passes all ValidatesRunner tests that non-portable runner passes

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. BEAM-2889 Flink runs portable pipelines

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved

          Activity

            People

              angoenka Ankur Goenka
              bsidhom Ben Sidhom
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: