Details
-
Bug
-
Status: Closed
-
Major
-
Resolution: Fixed
-
SystemDS 3.1
-
None
-
None
Description
Running MLogreg on a subset of Criteo in one-hot encoded form (with ~1M columns) is slow because performance is dominated by unnecessary transpose operations that are not compiled in local CP operations.
Heavy Hitters for Mlogreg with maxi=30 with coordinator and 3 workers (fed-par-inst=1) on localhost.
1 m_multiLogReg 218.289 1 2 fed_r' 129.660 29 3 fed_mmchain 32.098 63 4 fed_ba+* 18.524 62 5 fed_transformencode 15.455 1 6 fed_fedinit 8.052 1 7 * 7.354 754 8 n+ 7.332 121 9 +* 2.253 127 10 - 2.152 361