Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-15411

[C++][Datasets] Improve memory usage of datasets

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • C++
    • None

    Description

      This is a parent issue to track a number of issues related to improving the runtime memory requirements of a dataset scan.

      Attachments

        Issue Links

          depends upon

          Bug - A problem which impairs or prevents the functions of the product. ARROW-14736 [C++][R]Opening a multi-file dataset and writing a re-partitioned version of it fails

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-13161 [C++][Dataset] Allow setting FragmentReadahead to 0 in ScannerBuilder

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-14648 [C++][Dataset] Change scanner readahead limits to be based on bytes instead of number of batches

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-15410 [C++][Datasets] Improve memory usage of datasets API when scanning parquet

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              westonpace Weston Pace
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: