Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4160 Vectorized Query Execution in Hive
  3. HIVE-4770

Null Pointer Exception in Group By Operator

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • vectorization-branch
    • vectorization-branch, 0.13.0
    • None
    • None

    Description

      Table and data attached.

      SELECT   cfloat,
               csmallint,
               cint,
               ctimestamp,
               (cfloat + 10),
               STDDEV_SAMP(cfloat),
               (-((cfloat + 10))),
               (cint / cfloat),
               MAX(cint),
               (-(cint)),
               (cint * STDDEV_SAMP(cfloat)),
               STDDEV_SAMP(cint),
               VAR_SAMP(cint),
               (-(MAX(cint))),
               ((-(MAX(cint))) / 0.00000000000000000000E+000)
      FROM     alltypes_orc
      WHERE    (((1 >= cfloat)
                 OR (cstring2 LIKE '%b'))
                OR ((cint <= csmallint)
                    OR (cstring2 LIKE '%ss')))
      GROUP BY cfloat, csmallint, cint, ctimestamp
      ORDER BY cint, cfloat;
      
      java.lang.RuntimeException: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"ctinyint":null,"csmallint":-3806,"cint":-66533315,"cbigint":null,"cdouble":null,"cfloat":152.95706,"cstring1":null,"cstring2":null,"ctimestamp":"9131-01-01 16:52:03.53","cboolean":null}
      	at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:162)
      	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:50)
      	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
      	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
      	at org.apache.hadoop.mapred.Child$4.run(Child.java:271)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:396)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
      	at org.apache.hadoop.mapred.Child.main(Child.java:265)
      Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while processing row {"ctinyint":null,"csmallint":-3806,"cint":-66533315,"cbigint":null,"cdouble":null,"cfloat":152.95706,"cstring1":null,"cstring2":null,"ctimestamp":"9131-01-01 16:52:03.53","cboolean":null}
      	at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:671)
      	at org.apache.hadoop.hive.ql.exec.ExecMapper.map(ExecMapper.java:144)
      	... 8 more
      Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.NullPointerException
      	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:796)
      	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
      	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
      	at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:88)
      	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
      	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
      	at org.apache.hadoop.hive.ql.exec.FilterOperator.processOp(FilterOperator.java:136)
      	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
      	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
      	at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:90)
      	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
      	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
      	at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:652)
      	... 9 more
      Caused by: java.lang.NullPointerException
      	at org.apache.hadoop.hive.ql.exec.GroupByOperator.shouldBeFlushed(GroupByOperator.java:941)
      	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processHashAggr(GroupByOperator.java:836)
      	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processKey(GroupByOperator.java:723)
      	at org.apache.hadoop.hive.ql.exec.GroupByOperator.processOp(GroupByOperator.java:791)
      	... 21 more
      

      Attachments

        1. tableAndData.zip
          244 kB
          Tony Murphy
        2. output.txt
          5 kB
          Tony Murphy

        Activity

          People

            jnp Jitendra Nath Pandey
            anthony.murphy Tony Murphy
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: