Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
Description
This is follow up Jira of FLINK-34471.
FLINK-34471 assuming all connections type are ALL_TO_ALL. This Jira will optimize it to save some network memory for forward and rescale connection.
Following is the optimization logic:
- When the connection type is FORWARD and the parallelism of 2 tasks are same. We calculate network memory based on FORWARD connection.
- When the connection type is FORWARD and the parallelism of 2 tasks are not same. We calculate network memory based on RESCALE connection.
- When the connection type is RESCALE. We calculate network memory based on RESCALE connection.
Attachments
Issue Links
- links to