Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-41279 Feature parity: DataFrame API in Spark Connect
  3. SPARK-42969

Fix the comparison the result with Arrow optimization enabled/disabled.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • None
    • Tests
    • None

    Description

      in test_arrow, there are a bunch of comparison between DataFrames with Arrow optimization enabled/disabled.

      These should be fixed to compare with the expected values so that it can be reusable for Spark Connect parity tests.

      Attachments

        Activity

          People

            ueshin Takuya Ueshin
            ueshin Takuya Ueshin
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: