Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4318

Drill hangs with a malformed Tpcds query

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Cannot Reproduce
    • 1.5.0
    • None
    • None

    Description

      git.commit.id.abbrev=3d0b4b0

      The below query never returns anything. The query is malformed as the columns in subquery are im-properly qualified.

      SELECT i.i_manufact_id,
                      Sum(ss.ss_ext_sales_price) total_sales
               FROM   store_sales ss,
                      date_dim dd,
                      customer_address ca,
                      item i
               WHERE  i.i_manufact_id IN (SELECT i.i_manufact_id
                                        FROM   item
                                        WHERE  i.i_category IN ( 'Books' ))
                      AND ss.ss_item_sk = i.i_item_sk
                      AND ss.ss_sold_date_sk = dd.d_date_sk
                      AND dd.d_year = 1999
                      AND dd.d_moy = 3
                      AND ss.ss_addr_sk = ca.ca_address.ss_sk
                      AND ca.ca_gmt_offset = -5
               GROUP  BY i.i_manufact_id
      

      Below is the information from the logs

      2016-01-28 00:45:17,997 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.drill.exec.work.foreman.Foreman - Query text for query id 29569b62-73b4-f270-98db-7eedf1803895: SELECT i.i_manufact_id,
                      Sum(ss.ss_ext_sales_price) total_sales
               FROM   store_sales ss,
                      date_dim dd,
                      customer_address ca,
                      item i
               WHERE  i.i_manufact_id IN (SELECT i.i_manufact_id
                                        FROM   item
                                        WHERE  i.i_category IN ( 'Books' ))
                      AND ss.ss_item_sk = i.i_item_sk
                      AND ss.ss_sold_date_sk = dd.d_date_sk
                      AND dd.d_year = 1999
                      AND dd.d_moy = 3
                      AND ss.ss_addr_sk = ca.ca_address.ss_sk
                      AND ca.ca_gmt_offset = -5
               GROUP  BY i.i_manufact_id
      2016-01-28 00:45:18,616 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Took 0 ms to get file statuses
      2016-01-28 00:45:18,720 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Fetch parquet metadata: Executed 1 out of 1 using 1 threads. Time: 101ms total, 101.682269ms avg, 101ms max.
      2016-01-28 00:45:18,721 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Fetch parquet metadata: Executed 1 out of 1 using 1 threads. Earliest start: 11.148000 μs, Latest start: 11.148000 μs, Average start: 11.148000 μs .
      2016-01-28 00:45:18,721 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Took 104 ms to read file metadata
      2016-01-28 00:45:18,909 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Took 0 ms to get file statuses
      2016-01-28 00:45:18,936 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Fetch parquet metadata: Executed 2 out of 2 using 2 threads. Time: 25ms total, 21.543874ms avg, 24ms max.
      2016-01-28 00:45:18,937 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Fetch parquet metadata: Executed 2 out of 2 using 2 threads. Earliest start: 1205.628000 μs, Latest start: 1455.366000 μs, Average start: 1330.497000 μs .
      2016-01-28 00:45:18,937 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Took 27 ms to read file metadata
      2016-01-28 00:45:18,943 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Took 0 ms to get file statuses
      2016-01-28 00:45:18,954 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Fetch parquet metadata: Executed 1 out of 1 using 1 threads. Time: 10ms total, 10.416335ms avg, 10ms max.
      2016-01-28 00:45:18,954 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Fetch parquet metadata: Executed 1 out of 1 using 1 threads. Earliest start: 1.002000 μs, Latest start: 1.002000 μs, Average start: 1.002000 μs .
      2016-01-28 00:45:18,954 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Took 11 ms to read file metadata
      2016-01-28 00:45:18,960 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Took 0 ms to get file statuses
      2016-01-28 00:45:18,980 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Fetch parquet metadata: Executed 1 out of 1 using 1 threads. Time: 20ms total, 20.511432ms avg, 20ms max.
      2016-01-28 00:45:18,981 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Fetch parquet metadata: Executed 1 out of 1 using 1 threads. Earliest start: 0.944000 μs, Latest start: 0.944000 μs, Average start: 0.944000 μs .
      2016-01-28 00:45:18,981 [29569b62-73b4-f270-98db-7eedf1803895:foreman] INFO  o.a.d.exec.store.parquet.Metadata - Took 20 ms to read file metadata
      

      Attachments

        1. error.log
          15 kB
          Rahul Kumar Challapalli

        Activity

          People

            Unassigned Unassigned
            rkins Rahul Kumar Challapalli
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: