Details

    • Sub-task
    • Status: Open
    • P3
    • Resolution: Unresolved
    • None
    • None
    • testing
    • None

    Description

      Use a persistent cache directory for pip install calls (at https://github.com/apache/beam/blob/master/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy#L1771 and some more in that file.)

      Pip does support caching (https://pip.pypa.io/en/stable/reference/pip_install/#caching) but the default directory may not be persistent across jobs.

      ibzib you mentioned that this might help with container build times. Containers are build by runnin pip inside the container, I am not sure if that will be possible to use the same shared cache for that process or not.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              altay Ahmet Altay
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: