Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-28202

Incorrect projected column size after ORC upgrade to v1.6.7

    XMLWordPrintableJSON

Details

    Description

      `ReaderImpl.getRawDataSizeFromColIndices` changed behavior for handling struct type and now includes their subtypes. That caused an issue in Hive as the root struct index is always "included", causing size estimation for the complete schema, not just selected columns leading to incorrect split estimations.

      Attachments

        Issue Links

          fixes

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-23553 Upgrade ORC version to 1.6.7

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #5195

          Activity

            People

              dkuzmenko Denys Kuzmenko
              dkuzmenko Denys Kuzmenko
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: