Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9615

Make re2's max_mem option configurable via an Impala startup flag.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 3.4.0
    • Impala 4.2.0
    • Backend
    • ghx-label-2

    Description

      Right now Impala always uses the default max_mem value for re2 regexp pattern matching.

      For more memory consuming patterns this can cause the following error:
      "re2/re2.cc:667: DFA out of memory: size xxxxx, bytemap range xx, list count xxxxx".

      It would be nice if re2's max_mem option would be configurable via an Impala startup flag.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-5256 ERROR log files can get very large

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              oshahidi Omid Shahidi
              attilaj Attila Jeges
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: