Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
SystemDS 3.1
-
None
Description
This task is to add a primitive called scheme, that should be the minimum information needed to take a compression scheme and apply it to new data.
To do this it is assumed that the new data have a specific structure - aka it maintains the number of distinct values, and rough characteristics of the previous input data.
if not the scheme is allowed to return null.
For initial implementation all cases should return null, followed by more advanced features, that allow the individual specializations of the different compression schemes to encode correctly. and more fundamentally combine via compressed appending to already encoded data.