Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27764

Feature Parity between PostgreSQL and Spark

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0
    • None
    • SQL
    • None

    Description

      PostgreSQL is one of the most advanced open source databases. This umbrella Jira is trying to track the missing features and bugs. 

      UPDATED: This umbrella tickets basically intend to include bug reports and general issues for the feature parity. For implementation-dependent behaviours and ANS/SQL standard topics, you need to check the two umbrella below;

      • SPARK-30374 Feature Parity between PostgreSQL and Spark (ANSI/SQL)
      • SPARK-30375 Feature Parity between PostgreSQL and Spark (implementation-dependent behaviours)

      Attachments

        Issue Links

          incorporates

          Umbrella - An overarching type made of sub-tasks SPARK-26217 Compliance to SQL standard (SQL:2011)

          • Major - Major loss of function.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-28696 create database _; allowing in Spark but Hive throws Parse Exception

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-29836 PostgreSQL dialect: cast

          • Major - Major loss of function.
          • Resolved
          relates to

          Umbrella - An overarching type made of sub-tasks SPARK-30375 Feature Parity between PostgreSQL and Spark (implementation-dependent behaviours)

          • Major - Major loss of function.
          • Open

          Umbrella - An overarching type made of sub-tasks SPARK-27763 Port test cases from PostgreSQL to Spark SQL

          • Major - Major loss of function.
          • Resolved

          Umbrella - An overarching type made of sub-tasks SPARK-30374 Feature Parity between PostgreSQL and Spark (ANSI/SQL)

          • Major - Major loss of function.
          • Resolved
          1.
          		 Handling of sublinks within outer-level aggregates. Sub-task Open Unassigned
          2.
          		 List all cases that PostgreSQL throws an exception but Spark SQL is NULL Sub-task Open Unassigned
          3.
          		 support statement using nested joins Sub-task Reopened Unassigned
          4.
          		 `lag` second argument must be a literal Sub-task Open Unassigned
          5.
          		 Order by does not accept a call to rank() Sub-task Open Unassigned
          6.
          		 ntile only accepting positive (>0) values Sub-task Open Unassigned
          7.
          		 Date/Timestamp type have different low value and high value with Spark Sub-task Open Unassigned
          8.
          		 Date/Time Output Styles and Date Order Conventions Sub-task Open Unassigned
          9.
          		 Handling outer links in CTE subquery expressions Sub-task Open Unassigned
          10.
          		 Decimal can not accept NaN as input Sub-task Open Unassigned
          11.
          		 Decimal can only support precision up to 38 Sub-task Open Unassigned
          12.
          		 Add more Date/Time Operators Sub-task Open Unassigned
          13.
          		 SELECT FROM syntax Sub-task Open Unassigned
          14.
          		 Join with USING caluse doesn't hide original tables Sub-task Open Unassigned
          15.
          		 Spark `exclude` always expecting `()` Sub-task Open Unassigned
          16.
          		 Different format when casting interval type to string type Sub-task Open Unassigned
          17.
          		 frame bound must be a literal Sub-task Open Unassigned
          18.
          		 Adds support to `groups` unit type in window clauses Sub-task Open Unassigned
          19.
          		 ORDER BY in aggregate function Sub-task Open Unassigned
          20.
          		 [UDF] Supports for alter, rename, owner change should be supported in Spark Sub-task Open Unassigned
          21.
          		 String Constants with C-style Escapes Sub-task Open Unassigned
          22.
          		 Support special date/timestamp values `infinity`/`-infinity` Sub-task Open Unassigned
          23.
          		 Ignore case while resolving time zones Sub-task Open Unassigned
          24.
          		 Support seconds precision by the timestamp type Sub-task Open Unassigned
          25.
          		 Interval strings without explicit unit markings Sub-task Open Unassigned
          26.
          		 Construct intervals from the `millenniums`, `centuries` or `decades` units Sub-task Open Unassigned
          27.
          		 Support synonyms for interval units Sub-task Open Unassigned
          28.
          		 Support writing `INTERVAL` type to datasource table Sub-task Open Unassigned
          29.
          		 Interval output styles Sub-task Open Unassigned
          30.
          		 Support the optional prefix `@` in interval strings Sub-task Open Unassigned
          31.
          		 Support `ago` in interval strings Sub-task Open Unassigned
          32.
          		 Support ISO 8601 format for intervals Sub-task In Progress Unassigned
          33.
          		 Precision of the interval type Sub-task Open Unassigned
          34.
          		 Support syntax for zero interval Sub-task Open Unassigned
          35.
          		 Unordered interval units Sub-task In Progress Unassigned
          36.
          		 Make COLUMN optional in ALTER TABLE Sub-task Open Unassigned
          37.
          		 Can't parse '11:00 BST' or '2000-10-19 10:23:54+01' signatures to timestamp Sub-task Open Unassigned
          38.
          		 Support data insertion in a different order if you wish or even omit some columns in spark sql also like postgresql Sub-task Open Unassigned
          39.
          		 Support sum with interval type values Sub-task Reopened Unassigned
          40.
          		 Support average with interval type values Sub-task Reopened Unassigned
          41.
          		 Support grouping function with multiple arguments Sub-task Open Unassigned
          42.
          		 Different answers in nested aggregates with window functions Sub-task Open Unassigned
          43.
          		 Support nested grouping sets Sub-task Open Unassigned
          44.
          		 Resolve group-by columns with integrity constraints Sub-task Open Unassigned
          45.
          		 Support grouping() in GROUP BY without GroupingSets/Cube/Rollup Sub-task Open Unassigned
          46.
          		 Support the combinations of grouping operations Sub-task Open Unassigned
          47.
          		 Support more expressive forms in GroupingSets/Cube/Rollup Sub-task Open Unassigned
          48.
          		 Support an empty grouping expression Sub-task Open Unassigned
          49.
          		 Support nested aggregates Sub-task Open Unassigned
          50.
          		 Improved VALUES support Sub-task Open Unassigned
          51.
          		 Support POSIX Regular Expressions Sub-task Open Unassigned
          52.
          		 Support COMMENT ON syntax Sub-task Open Unassigned
          53.
          		 SQL Datetime util function being casted to double instead of timestamp Sub-task Reopened Unassigned
          54.
          		 support drop multiple functions Sub-task Open Unassigned

          Activity

            People

              Unassigned Unassigned
              smilegator Xiao Li
              Votes:
              3 Vote for this issue
              Watchers:
              24 Start watching this issue

              Dates

                Created:
                Updated: