Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-9578

Enumerating artifacts is too expensive in Java

    XMLWordPrintableJSON

Details

    Description

      There are a lot of places (e.g. ParDoTranslation#getParDoPayload) which effectively call Environments#createOrGetDefaultEnvironment which causes artifacts to be computed.

      This leads to zipping directories for non-jar dependencies.

      Similar problems may exist for Python/Go.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. BEAM-9534 Flink testParDoRequiresStableInput timed out

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          is caused by

          Sub-task - The sub-task of the issue BEAM-9056 Staging artifacts from environment

          • P2 - Default priority. Will be triaged and planned according to community practices.
          • Resolved
          links to

          Web Link GitHub Pull Request #11205

          Web Link PR #10621

          Activity

            People

              heejong Heejong Lee
              lcwik Luke Cwik
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 8h 10m
                  8h 10m