Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4998

Perform parquet filter pushdown in logical planning.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      DRILL-1950 put parquet filter pushdown rule in physical planning phase, after all join order related tasks have been done. Main reason for doing this is we want to reduce the performance regression possibility caused by a different join order, as a result of reduced row count in scan operator.

      Ideally this should be done in logical planning, before join order planning is done. Before we can make such change, we have to figure out how to adjust the selectivity estimation of filter operator, after filter is pushed down to scan.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              jni Jinfeng Ni
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: