Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-4160 Vectorized Query Execution in Hive
  3. HIVE-4774

Hive Runtime Error while closing operators: java.lang.NullPointerException

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • vectorization-branch
    • vectorization-branch, 0.13.0
    • None
    • None

    Description

      table and data attached

      SELECT   cdouble,
               cint,
               (cdouble - -1),
               (-((cdouble - -1))),
               MIN((-((cdouble - -1)))),
               STDDEV_SAMP(cdouble),
               (0.00000000000000000000E+000 / (cdouble - -1))
      FROM     alltypes_orc
      WHERE    ((cdouble < cint)
                OR (cdouble <= cint))
      GROUP BY cdouble, cint
      ORDER BY cint;
      
      java.lang.RuntimeException: Hive Runtime Error while closing operators
      	at org.apache.hadoop.hive.ql.exec.vector.VectorExecMapper.close(VectorExecMapper.java:229)
      	at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:57)
      	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:436)
      	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
      	at org.apache.hadoop.mapred.Child$4.run(Child.java:271)
      	at java.security.AccessController.doPrivileged(Native Method)
      	at javax.security.auth.Subject.doAs(Subject.java:396)
      	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1135)
      	at org.apache.hadoop.mapred.Child.main(Child.java:265)
      Caused by: java.lang.NullPointerException
      	at org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serialize(LazyBinarySerDe.java:292)
      	at org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serializeStruct(LazyBinarySerDe.java:257)
      	at org.apache.hadoop.hive.serde2.lazybinary.LazyBinarySerDe.serialize(LazyBinarySerDe.java:204)
      	at org.apache.hadoop.hive.ql.exec.ReduceSinkOperator.processOp(ReduceSinkOperator.java:245)
      	at org.apache.hadoop.hive.ql.exec.Operator.process(Operator.java:502)
      	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:832)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.flush(VectorGroupByOperator.java:302)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorGroupByOperator.closeOp(VectorGroupByOperator.java:423)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:588)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      	at org.apache.hadoop.hive.ql.exec.Operator.close(Operator.java:597)
      	at org.apache.hadoop.hive.ql.exec.vector.VectorExecMapper.close(VectorExecMapper.java:196)
      	... 8 more
      
      

      Attachments

        1. hive-4774.1.patch
          2 kB
          Remus Rusanu
        2. output.txt
          4 kB
          Tony Murphy
        3. tableAndData.zip
          244 kB
          Tony Murphy

        Activity

          People

            rusanu Remus Rusanu
            anthony.murphy Tony Murphy
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: