Uploaded image for project: 'SystemDS'
  1. SystemDS
  2. SYSTEMDS-968

Missing bufferpool eviction of frames

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • SystemML 0.11
    • SystemML 0.11
    • None
    • None

    Description

      Frames have been integrated into the buffer pool. However, the implementation of getInMemorySize and getExactSerializedSize always returns 1 which means that frame are effectively never evicted. This is problematic as it leads to out-of-memory errors.

      This task tracks the proper full integration of frames into the buffer pool which entails (1) an implementation of size estimation methods, and (2) the fix of the input/output code path in order to prevent the usage of FastBufferDataInputStream and FastBufferedDataOutputStream for frames because these streams do not implement readUTF/writeUTF.

      Attachments

        Issue Links

          Activity

            There are no comments yet on this issue.

            People

              mboehm7 Matthias Boehm
              mboehm7 Matthias Boehm
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: