Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4828

We are not reading from sub-directory cache when we have a filter on an auto-partition column

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.7.0
    • None
    • None

    Description

      git.commit.id.abbrev=f476eb5

      The below plan indicates that we are reading from the top-level cache

      0: jdbc:drill:zk=10.10.100.190:5181> explain plan for select * from s_1level where dir0 = 'A' and par = 1 and s_nationkey < 2;
      +------+------+
      | text | json |
      +------+------+
      | 00-00    Screen
      00-01      Project(*=[$0])
      00-02        Project(T104¦¦*=[$0])
      00-03          SelectionVectorRemover
      00-04            Filter(condition=[AND(=($1, 'A'), =($2, 1), <($3, 2))])
      00-05              Project(T104¦¦*=[$0], dir0=[$1], par=[$2], s_nationkey=[$3])
      00-06                Scan(groupscan=[ParquetGroupScan [entries=[ReadEntryWithPath [path=/drill/testdata/metadata_caching_pp/s_1level/A/0_0_1.parquet]], selectionRoot=/drill/testdata/metadata_caching_pp/s_1level, numFiles=1, usedMetadataFile=true, cacheFileRoot=/drill/testdata/metadata_caching_pp/s_1level, columns=[`*`]]])
      

      I attached the data set used. Let me know if you need anything else.

      Attachments

        1. s_1level.tgz
          9 kB
          Rahul Kumar Challapalli

        Activity

          People

            Unassigned Unassigned
            rkins Rahul Kumar Challapalli
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: