Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-12847

Make computeScanRangeLocations and computeStats idempotent in HdfsScanNode.java

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 4.4.0
    • Frontend
    • None

    Description

      After IMPALA-12631, HdfsScanNode.computeScanRangeLocations() need check if countStarSlot_ is null or not to schedule footer range only. HdfsScanNode.computeScanRangeLocations() is called along with HdfsScanNode.init() call.

      An external frontend that has its own count star slot analysis and initialization will need to recompute scan range assignment and stats after HdfsScanNode.init(). Therefore, computeScanRangeLocations() and computeStats() should be made idempotent after init() and exposed to subclasses.

      Attachments

        Activity

          People

            rizaon Riza Suminto
            rizaon Riza Suminto
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: