[BEAM-3177] Add a Pipeline option to set default logging level (DEBUG, INFO, etc) for Python SDK harness. - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Open
Priority: P3
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: sdk-py-harness
Labels:
None

Description

Currently Pipeline options in Python SDK[3] don't have a concept of default logging level for SDK harness and we hardcode it [1]. For comparison, see Java counterpart [2].

[1] https://github.com/apache/beam/blob/2b4a6b5d5cb455fe73971fde4caa7d1446cd55aa/sdks/python/apache_beam/runners/worker/sdk_worker_main.py#L43
[2] https://github.com/apache/beam/blob/2b4a6b5d5cb455fe73971fde4caa7d1446cd55aa/sdks/java/core/src/main/java/org/apache/beam/sdk/options/SdkHarnessOptions.java#L62
[3] https://github.com/apache/beam/blob/master/sdks/python/apache_beam/options/pipeline_options.py

Attachments

Issue Links

blocks

BEAM-14147 Log GCS upload ID for Python GCS connector

Open

relates to

BEAM-5468 Allow runner to set worker log level in Python SDK harness.

Open

Activity

People

Assignee:: Unassigned

Reporter:: Valentyn Tymofieiev

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 13/Nov/17 20:00

Updated:: 03/Jun/22 19:27