Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-34502

Support calculating network memory for forward and rescale edge

    XMLWordPrintableJSON

Details

    Description

      This is follow up Jira of FLINK-34471.

      FLINK-34471 assuming all connections type are ALL_TO_ALL. This Jira will optimize it to save some network memory for forward and rescale connection.

      Following is the optimization logic:

      • When the connection type is FORWARD and the parallelism of 2 tasks are same. We calculate network memory based on FORWARD connection.
      • When the connection type is FORWARD and the parallelism of 2 tasks are not same. We calculate network memory based on RESCALE connection.
      • When the connection type is RESCALE. We calculate network memory based on RESCALE connection.

      Attachments

        Issue Links

          Activity

            People

              fanrui Rui Fan
              fanrui Rui Fan
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: