Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-11010

Fixes and enhancements addressing UDTs' api and several usability concerns

    XMLWordPrintableJSON

Details

    • Epic
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 1.5.0, 1.5.1
    • None
    • SQL
    • UserDefinedType enhancements

    Description

      Catalyst SQL types allow for UserDefinedTypes, but do not allow for easy extension of 3rd party types or extensions to built-in types like DecimalType or StringType (private classes).

      Additionally, the API can infer much more of what's needed from the type parameter than it currently does.

      Attachments

        Issue Links

          incorporates

          New Feature - A new feature of the product, which has yet to be developed. SPARK-7768 Make user-defined type (UDT) API public

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-11003 Allowing UserDefinedTypes to extend primatives

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-10855 Add a JDBC dialect for Apache Derby

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              blue666man John Muller
              Votes:
              6 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 168h
                  168h
                  Remaining:
                  Remaining Estimate - 168h
                  168h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified