Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-12202

NPE thrown when reading legacy ACID delta files

    XMLWordPrintableJSON

Details

    • Reading legacy ACID formats (prior to 1.3.0) no longer results in an NPE.

    Description

      When reading legacy ACID deltas of the form delta_$startTxnId_$endTxnId a NullPointerException is thrown on:

      org.apache.hadoop.hive.ql.io.AcidUtils.deserializeDeltas#371
      if(dmd.getStmtIds().isEmpty()) {
      

      The older ACID data format (pre-Hive 1.3.0) which does not include the statement ID, and code written for that format should still be supported. Therefore the above condition should also include a null check or alternatively AcidInputFormat.DeltaMetaData should never return null, and return an empty list in this specific scenario.

      Attachments

        1. HIVE-12202.0.patch
          5 kB
          Elliot West

        Issue Links

          Activity

            People

              teabot Elliot West
              teabot Elliot West
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: