Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-1037

SerDe & ObjectInspector for RowContainer mismatch with the input data

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • None
    • 0.5.0
    • None
    • None
    • Reviewed

    Description

      In CommonJoinOperator, RowContainer is created for each input table with the SerDe and ObjectInspector to serialize/deserialize that row to persistent storage. The serde/OI could be null in the case of the value columns are pruned by column pruner. An example query is

      select count(1) from A join B on A.key=B.key;

      Another case of mismatch is that the tableDesc was initialized at compile time before the column pruner take place. This could cause inconsistency in the SerDe/OI with the input data. This should be moved to execution time when the join operator is initialized.

      Attachments

        1. HIVE-1037.patch
          88 kB
          Ning Zhang

        Activity

          People

            nzhang Ning Zhang
            nzhang Ning Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: