Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • Connect
    • None

    Description

      File "/Users/s.singh/personal/spark-oss/python/pyspark/sql/connect/functions.py", line 1472, in pyspark.sql.connect.functions.posexplode_outer
      Failed example:
          df.select("id", "a_map", posexplode_outer("an_array")).show()
      Expected:
          +---+----------+----+----+
          | id|     a_map| pos| col|
          +---+----------+----+----+
          |  1|{x -> 1.0}|   0| foo|
          |  1|{x -> 1.0}|   1| bar|
          |  2|        {}|null|null|
          |  3|      null|null|null|
          +---+----------+----+----+
      Got:
          +---+------+----+----+
          | id| a_map| pos| col|
          +---+------+----+----+
          |  1| {1.0}|   0| foo|
          |  1| {1.0}|   1| bar|
          |  2|{null}|null|null|
          |  3|  null|null|null|
          +---+------+----+----+
          <BLANKLINE>

      Attachments

        Activity

          People

            podongfeng Ruifeng Zheng
            techaddict Sandeep Singh
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: