Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-19632

Allow configuring non-hive and non-local SessionState and ExternalCatalog

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • 2.1.0
    • None
    • SQL
    • None

    Description

      I want to be able to integrate non hive catalogs into spark. It seems api is pretty close already. This issue proposes opening up existing interfaces for external implementation.

      For ExternalCatalog there seems to be already an abstract class and SessionState java doc suggests it should stay a scala class to avoid initialization order

      Attachments

        Issue Links

          duplicates

          Sub-task - The sub-task of the issue SPARK-17767 Spark SQL ExternalCatalog API custom implementation support

          • Major - Major loss of function.
          • Closed
          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-30617 Is there any possible that spark no longer restrict enumerate types of spark.sql.catalogImplementation

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          links to

          Pull request #16963 [Github] Pull Request #16963 (robert3005)

          Activity

            People

              Unassigned Unassigned
              robert3005 Robert Kruszewski
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: