Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Incomplete
-
2.3.0
-
None
Description
The new DataSourceV2 API needs to stabilize the InternalRow interface so that it can be used by new data source implementations. It already exposes UnsafeRow for reads and InternalRow for writes, and the representations are unlikely to change so this is primarily documentation work.
For more discussion, see SPARK-23325.
Attachments
Issue Links
- relates to
-
SPARK-23325 DataSourceV2 readers should always produce InternalRow.
- Resolved
- links to