Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23483 Feature parity for Python vs Scala APIs
  3. SPARK-23084

Add unboundedPreceding(), unboundedFollowing() and currentRow() to PySpark

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 2.3.0
    • None
    • PySpark
    • None

    Description

      Add the new APIs (introduced by https://github.com/apache/spark/pull/18814) to PySpark. Also update the rangeBetween API

      /**
       * Window function: returns the special frame boundary that represents the first row in the
       * window partition.
       *
       * @group window_funcs
       * @since 2.3.0
       */
       def unboundedPreceding(): Column = Column(UnboundedPreceding)
      
      /**
       * Window function: returns the special frame boundary that represents the last row in the
       * window partition.
       *
       * @group window_funcs
       * @since 2.3.0
       */
       def unboundedFollowing(): Column = Column(UnboundedFollowing)
      
      /**
       * Window function: returns the special frame boundary that represents the current row in the
       * window partition.
       *
       * @group window_funcs
       * @since 2.3.0
       */
       def currentRow(): Column = Column(CurrentRow)
      
      

      Attachments

        Issue Links

          Activity

            People

              huaxing Huaxin Gao
              smilegator Xiao Li
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: