Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
1.14.0
-
None
Description
Parquet Complex reader while fetching nested schema should have configurable memory or max records to fetch and not default to 4000 records.
While scanning TB of data with wider columns, this could easily cause OOM issues.
Attachments
Issue Links
- links to