|
|
|
SPARK-42920
|
SPARK-41283
Python UDF with UDT
|
Takuya Ueshin
|
Takuya Ueshin
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-42907
|
SPARK-41283
Implement Avro functions
|
Unassigned
|
Ruifeng Zheng
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
SPARK-42612
|
SPARK-41283
Enable more parity tests related to functions
|
Takuya Ueshin
|
Takuya Ueshin
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-42434
|
SPARK-41283
`array_append` should accept `Any` value
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-42433
|
SPARK-41283
Add `array_insert` to Connect
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-42155
|
SPARK-41283
Add `array_append` to Connect
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Resolved
|
|
|
|
|
|
|
|
SPARK-42099
|
SPARK-41283
Make `count(*)` work correctly
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-42077
|
SPARK-41283
Literal should throw TypeError for unsupported DataType
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-42048
|
SPARK-41283
Different column name of lit(np.int8)
|
Takuya Ueshin
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-42047
|
SPARK-41283
Literal should support numpy datatypes
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-42032
|
SPARK-41283
Map data show in different order
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41929
|
SPARK-41283
Add function array_compact
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41928
|
SPARK-41283
Add the unsupported list for functions
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41880
|
SPARK-41283
Function `from_json` should support non-literal expression
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41852
|
SPARK-41283
Fix `pmod` function
|
Ruifeng Zheng
|
Sandeep Singh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41851
|
SPARK-41283
Fix `nanvl` function
|
Ruifeng Zheng
|
Sandeep Singh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41845
|
SPARK-41283
Fix `count(expr("*"))` function
|
Ruifeng Zheng
|
Sandeep Singh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41844
|
SPARK-41283
Implement `intX2` function
|
Unassigned
|
Sandeep Singh
|
|
Resolved |
Invalid
|
|
|
|
|
|
|
|
SPARK-41836
|
SPARK-41283
Implement `transform_values` function
|
Ruifeng Zheng
|
Sandeep Singh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41835
|
SPARK-41283
Implement `transform_keys` function
|
Ruifeng Zheng
|
Sandeep Singh
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41809
|
SPARK-41283
Make json functions support DataType Schema
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41808
|
SPARK-41283
Make json functions support options
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41803
|
SPARK-41283
log() function variations are missing
|
Ruifeng Zheng
|
Martin Grund
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41797
|
SPARK-41283
Enable test for `array_repeat`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41786
|
SPARK-41283
Deduplicate helper functions
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41728
|
SPARK-41283
Implement `unwrap_udt` function
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41724
|
SPARK-41283
Implement `call_udf` function
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41723
|
SPARK-41283
Implement `sequence` function
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41722
|
SPARK-41283
Implement time window functions
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41700
|
SPARK-41283
Remove `FunctionBuilder`
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41672
|
SPARK-41283
Enable the deprecated functions
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41663
|
SPARK-41283
Implement the rest of Lambda functions
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41640
|
SPARK-41283
implement `Window` functions
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41545
|
SPARK-41283
Implement json functions
|
Ruifeng Zheng
|
Deng Ziming
|
|
Resolved |
Not A Problem
|
|
|
|
|
|
|
|
SPARK-41503
|
SPARK-41283
Implement Partition Transformation Functions
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41495
|
SPARK-41283
Implement `collection` functions: P~Z
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41494
|
SPARK-41283
Make json functions support options
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Resolved
|
|
|
|
|
|
|
|
SPARK-41493
|
SPARK-41283
Make csv functions support options
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41492
|
SPARK-41283
implement MISC function
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41484
|
SPARK-41283
Implement `collection` functions: E~M
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41473
|
SPARK-41283
Implement `functions.format_number`
|
Ruifeng Zheng
|
Xinrong Meng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41472
|
SPARK-41283
Implement the rest of string/binary functions
|
Xinrong Meng
|
Xinrong Meng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41455
|
SPARK-41283
Resolve dtypes inconsistencies of date/timestamp functions
|
Ruifeng Zheng
|
Xinrong Meng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41436
|
SPARK-41283
Implement `collection` functions: A~C
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41434
|
SPARK-41283
Support LambdaFunction expresssion
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41414
|
SPARK-41283
Implement date/timestamp functions
|
Xinrong Meng
|
Xinrong Meng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41397
|
SPARK-41283
Implement part of string/binary functions
|
Xinrong Meng
|
Xinrong Meng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41382
|
SPARK-41283
implement `product` function
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41381
|
SPARK-41283
Implement count_distinct and sum_distinct functions
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41380
|
SPARK-41283
Implement aggregation functions
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41364
|
SPARK-41283
implement `broadcast` function
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41363
|
SPARK-41283
implement normal functions
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41357
|
SPARK-41283
Implement math functions
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41346
|
SPARK-41283
Implement asc and desc methods
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41264
|
SPARK-41283
Make Literal support more datatypes
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41238
|
SPARK-41283
Support more datatypes
|
Ruifeng Zheng
|
Ruifeng Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-41225
|
SPARK-41283
Disable unsupported functions
|
Martin Grund
|
Martin Grund
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-40546
|
SPARK-41283
Homogenize built-in function names for binary operators like + - /
|
Unassigned
|
Martin Grund
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-40538
|
SPARK-41283
Add missing PySpark functions to Spark Connect
|
Martin Grund
|
Martin Grund
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
SPARK-40533
|
SPARK-41283
Extend type support for Spark Connect literals
|
Martin Grund
|
Martin Grund
|
|
Resolved |
Fixed
|
|
|
|
|