Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-19367

Hive metastore temporary configuration doesn't specify default filesystem

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Incomplete
    • 1.6.3, 2.0.2, 2.1.0, 2.2.0
    • None
    • SQL

    Description

      When a temporary configuration is obtained in HiveUtils, it specify the warehouse location on the local file system. This is fine, but if the default file system is specified different than local, it may fail due to the lack of required configuration options.

      What I propose here is to set default file system to file:/// in addition to setting warehouse location to local file system.

      Why - because regardless of what file system is accessed by Hive, it does initialisation with the default file system and if it requires some configuration, it will fail.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              jlewandowski Jacek Lewandowski
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: