Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-21187 Complete support for remaining Spark data types in Arrow Converters
  3. SPARK-23555

Add BinaryType support for Arrow in PySpark

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.4.0
    • PySpark
    • None

    Description

      BinaryType is supported with Arrow in Scala, but not yet in Python. It should be added for all codepaths using Arrow.

      Attachments

        Issue Links

          depends upon

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-2141 [Python] Conversion from Numpy object array to varsize binary unimplemented

          • Major - Major loss of function.
          • Resolved
          is blocked by

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-23874 Upgrade apache/arrow to 0.10.0

          • Major - Major loss of function.
          • Closed
          links to

          Pull request #20725 [Github] Pull Request #20725 (BryanCutler)

          Activity

            People

              bryanc Bryan Cutler
              bryanc Bryan Cutler
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: