Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-3209

Optimize scanner memory usage and make scan nodes adhere to a memory constraint

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • Impala 2.5.0
    • None
    • Backend

    Description

      Scanner memory usage can grow quite large. We should optimize scanner memory usage, and also make it possible to provide an upper bound on scan node memory usage.

      Just filing this to track what we've been talking about.

      Attachments

        Issue Links

          blocks

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-1723 Minimum Required Memory For TPCH-Q9 is inconsistent

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          duplicates

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-4835 HDFS scans should operate with a constrained number of I/O buffers

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-2831 Impala can spin up too many scanner threads

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              kwho Michael Ho
              dhecht Daniel Hecht
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: