Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Duplicate
-
None
-
None
-
None
Description
During a repartition phase, each worker pulls intermediate of completed tasks of one or more child execution blocks. However, a worker pulls the intermediate data completed at the same worker via HTTP. This causes unnecessary read/write overheads on disk. We should eliminate this overhead.
Attachments
Issue Links
- duplicates
-
TAJO-983 Worker should directly read Intermediate data stored in localhost rather than fetching
- Resolved