Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
Impala 2.0
-
None
-
None
-
commit 5fa91080db9871ddaceedf3ade96df7a3df3a76e
Author: Dan Hecht <dhecht@cloudera.com>
Date: Thu Sep 25 14:45:03 2014 -0700
IMPALA-1310: Handle creating parquet files with many columns
Description
The query below reliably fails a DCHECK. It runs for a min or so, then returns some results, then crashes.
SELECT SUM(t1.int_col * t1.id) OVER (ORDER BY t1.int_col * t1.id ASC, t3.year + t3.tinyint_col ASC ROWS BETWEEN 66 PRECEDING AND 21 FOLLOWING) AS int_col_1 FROM alltypes t1 INNER JOIN alltypes t2 ON t2.month = t1.smallint_col INNER JOIN alltypes t3 ON t3.bigint_col = t2.bigint_col WHERE t2.id <= t3.smallint_col + t2.tinyint_col;
Stack trace
(gdb) bt #0 0x00007f6d6424bbb9 in __GI_raise (sig=sig@entry=6) at ../nptl/sysdeps/unix/sysv/linux/raise.c:56 #1 0x00007f6d6424efc8 in __GI_abort () at abort.c:89 #2 0x0000000001eecd19 in google::DumpStackTraceAndExit () at src/utilities.cc:147 #3 0x0000000001ee5dcd in google::LogMessage::Fail () at src/logging.cc:1296 #4 0x0000000001ee7c55 in google::LogMessage::SendToLog (this=0x7f6d37f72950) at src/logging.cc:1250 #5 0x0000000001ee59cb in google::LogMessage::Flush (this=this@entry=0x7f6d37f72950) at src/logging.cc:1119 #6 0x0000000001ee85ae in google::LogMessageFatal::~LogMessageFatal (this=0x7f6d37f72950, __in_chrg=<optimized out>) at src/logging.cc:1817 #7 0x00000000013c0a5b in impala::BufferedTupleStream::NextBlockForRead (this=0x12265960) at /home/casey/Impala-test/be/src/runtime/buffered-tuple-stream.cc:223 #8 0x00000000013c28ed in impala::BufferedTupleStream::GetNext (this=0x12265960, batch=0x7f6d37f72c30, eos=0x7f6d37f72d66, indices=0x0) at /home/casey/Impala-test/be/src/runtime/buffered-tuple-stream.cc:366 #9 0x00000000014d3d39 in impala::AnalyticEvalNode::GetNextOutputBatch (this=0x8284600, state=0x6786e00, output_batch=0x93296c0, eos=0x7f6d37f72d66) at /home/casey/Impala-test/be/src/exec/analytic-eval-node.cc:607 #10 0x00000000014d47ab in impala::AnalyticEvalNode::GetNext (this=0x8284600, state=0x6786e00, row_batch=0x93296c0, eos=0x79a2e49) at /home/casey/Impala-test/be/src/exec/analytic-eval-node.cc:669 #11 0x00000000013b0429 in impala::PlanFragmentExecutor::GetNextInternal (this=0x79a2d20, batch=0x834fb60) at /home/casey/Impala-test/be/src/runtime/plan-fragment-executor.cc:478 #12 0x00000000013afeca in impala::PlanFragmentExecutor::GetNext (this=0x79a2d20, batch=0x834fb60) at /home/casey/Impala-test/be/src/runtime/plan-fragment-executor.cc:456 #13 0x0000000001372134 in impala::Coordinator::GetNext (this=0x68b3e00, batch=0x834fb60, state=0x6786e00) at /home/casey/Impala-test/be/src/runtime/coordinator.cc:805 #14 0x0000000001052fc7 in impala::ImpalaServer::QueryExecState::FetchNextBatch ( this=0x834e000) at /home/casey/Impala-test/be/src/service/query-exec-state.cc:811 #15 0x000000000105136f in impala::ImpalaServer::QueryExecState::FetchRowsInternal ( this=0x834e000, max_rows=1024, fetched_rows=0x7f6d37f73370) at /home/casey/Impala-test/be/src/service/query-exec-state.cc:667 #16 0x0000000001050a41 in impala::ImpalaServer::QueryExecState::FetchRows (this=0x834e000, max_rows=1024, fetched_rows=0x7f6d37f73370) at /home/casey/Impala-test/be/src/service/query-exec-state.cc:577