Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
SystemDS 3.1
Description
FederationUtils.bindResponses(...) causes a out of memory exception when we get sparse matrices from the federated workers.
This happens because we hardcode the MatrixObject to be dense, so when we try to copy the sparse data from the workers into the dense matrix, we can run out of memory depending on the size of the matrix.
I encountered this when running FTBenchT15. I've attached the log output with the trace below.
Attachments
Attachments
Issue Links
- links to