Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12030

Hive throws NPE with ACID enabled tables

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • 1.3.0
    • None
    • Transactions
    • None

    Description

      Code based on master: commit 507442319985198466b4f6c2ba18c6b068d8435e Date: Thu Oct 1

      Exception
      =========

      Caused by: java.io.IOException: java.lang.NullPointerException
              at org.apache.hadoop.hive.io.HiveIOExceptionHandlerChain.handleRecordReaderCreationException(HiveIOExceptionHandlerChain.java:97)
              at org.apache.hadoop.hive.io.HiveIOExceptionHandlerUtil.handleRecordReaderCreationException(HiveIOExceptionHandlerUtil.java:57)
              at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:253)
              at org.apache.hadoop.mapred.split.TezGroupedSplitsInputFormat$TezGroupedSplitsRecordReader.initNextRecordReader(TezGroupedSplitsInputFormat.java:193)
              ... 25 more
      Caused by: java.lang.NullPointerException
              at org.apache.hadoop.hive.ql.io.AcidUtils.deserializeDeltas(AcidUtils.java:371)
              at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getReader(OrcInputFormat.java:1272)
              at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.getRecordReader(OrcInputFormat.java:1190)
              at org.apache.hadoop.hive.ql.io.HiveInputFormat.getRecordReader(HiveInputFormat.java:250)
              ... 26 more
      

      Steps to reproduce the issue:
      =============================

      --hiveconf hive.support.concurrency=true --hiveconf hive.enforce.bucketing=true --hiveconf hive.exec.dynamic.partition.mode=nonstrict --hiveconf hive.txn.manager=org.apache.hadoop.hive.ql.lockmgr.DbTxnManager --hiveconf hive.compactor.initiator.on=true --hiveconf hive.compactor.worker.threads=1
      
      DROP TABLE `lineitem_acid_bucket`;
      
      CREATE TABLE `lineitem_acid_bucket`(
        `l_orderkey` bigint,
        `l_partkey` bigint,
        `l_suppkey` bigint,
        `l_linenumber` bigint,
        `l_quantity` double,
        `l_extendedprice` double,
        `l_discount` double,
        `l_tax` double,
        `l_returnflag` string,
        `l_linestatus` string,
        `l_shipdate` string,
        `l_commitdate` string,
        `l_receiptdate` string,
        `l_shipinstruct` string,
        `l_shipmode` string,
        `l_comment` string)
      CLUSTERED BY (l_orderkey)
      INTO 10 BUCKETS STORED AS ORC TBLPROPERTIES("transactional"="true"); 
      
      INSERT INTO lineitem_acid_bucket SELECT * FROM tpch_flat_orc_1000.lineitem WHERE l_orderkey > 0 AND l_orderkey < 10000000;
      
      INSERT INTO lineitem_acid_bucket SELECT * FROM tpch_flat_orc_1000.lineitem WHERE l_orderkey > 10000001 AND l_orderkey < 20000000;
      
      update lineitem_acid_bucket set l_quantity=1 where l_orderkey=5963520;
      
      ALTER TABLE lineitem_acid_bucket COMPACT 'minor';
      
      update lineitem_acid_bucket set l_quantity=1 where l_orderkey=5963520;
      
      exception thrown here
      
      

      Attachments

        1. HIVE-12030.1.patch
          0.8 kB
          Rajesh Balamohan

        Issue Links

          Activity

            People

              ekoifman Eugene Koifman
              rajesh.balamohan Rajesh Balamohan
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: