Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-6454

Native MapR DB plugin support for Hive MapR-DB json table

    XMLWordPrintableJSON

Details

    Description

      Hive can create and query MapR-DB tables via maprdb-json-handler:
      https://maprdocs.mapr.com/home/Hive/ConnectingToMapR-DB.html

      The aim of this Jira to implement Drill native reader for Hive MapR-DB tables (similar to parquet).

      Design proposal is:

      • to use JsonTableGroupScan instead of HiveScan;
      • to add storage planning rule to convert HiveScan to MapRDBGroupScan;
      • to add system/session option to enable using of this native reader;
      • native reader can be used only for Drill build with mapr profile (there is no reason to leverage it for default profile);

       

      For documentation:
      two new options were added:
      store.hive.parquet.optimize_scan_with_native_reader: false,
      store.hive.maprdb_json.optimize_scan_with_native_reader: false,

      store.hive.parquet.optimize_scan_with_native_reader is new option used instead of store.hive.optimize_scan_with_native_readers. The latter is deprecated and will be removed in 1.15.
      (https://issues.apache.org/jira/browse/DRILL-6527).

       

      Attachments

        Issue Links

          Activity

            People

              vitalii Vitalii Diravka
              vitalii Vitalii Diravka
              Gautam Parai Gautam Parai
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: