Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-36640

More operator pushdown API in Data Source V2

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.0
    • None
    • SQL
    • None

    Description

      As of Spark 3.2, we have DS v2 pushdown APIs for Filter, Aggregate, and column pruning. We may need more like Limit, Sort, Sample, etc.

      Attachments

        There are no Sub-Tasks for this issue.

        Activity

          People

            Unassigned Unassigned
            cloud_fan Wenchen Fan
            Votes:
            1 Vote for this issue
            Watchers:
            10 Start watching this issue

            Dates

              Created:
              Updated: