Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-24085

Scalar subquery error

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0, 2.3.1
    • 2.3.1, 2.4.0
    • SQL
    • None

    Description

      Error

      SQL Error: java.lang.UnsupportedOperationException: Cannot evaluate expression: scalar-subquery

      Then query a partitioed table based on a parquet file then filter by partition column by scalar subquery.

      Query to reproduce:

      CREATE TABLE test_prc_bug (
      id_value string
      )
      partitioned by (id_type string)
      location '/tmp/test_prc_bug'
      stored as parquet;
      
      insert into test_prc_bug values ('1','a');
      insert into test_prc_bug values ('2','a');
      insert into test_prc_bug values ('3','b');
      insert into test_prc_bug values ('4','b');
      
      
      select * from test_prc_bug
      where id_type = (select 'b');
      

      If table in ORC format it works fine

      Attachments

        Activity

          People

            dkbiswal Dilip Biswal
            abaturin Alexey Baturin
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: