[BEAM-13973] Link Dataproc Flink master URLs to the InteractiveRunner when FlinkRunner is used - ASF JIRA

XML

Word

Printable

JSON

Details

Type: New Feature
Status: Resolved
Priority: P2
Resolution: Implemented
Affects Version/s: None
Fix Version/s: 2.38.0
Component/s: runner-py-interactive
Labels:
None

Language:
- Python

Description

Continuation of the logic introduced in: https://github.com/apache/beam/pull/16741
Implements logic to get the Flink master and the link to the Flink dashboard for a corresponding DataprocClusterManager by parsing the output logs from the staging bucket of an existing Dataproc cluster
Adds functionality to connect the FlinkRunner to a Dataproc Flink master

Attachments

Issue Links

links to

GitHub Pull Request #16904

Activity

People

Assignee:: Victor Chen

Reporter:: Victor Chen

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 18/Feb/22 22:28

Updated:: 01/Apr/22 19:13

Resolved:: 02/Mar/22 19:30

Time Tracking

Estimated:

Not Specified

Remaining:

0h

Logged:

14h 10m