Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-5167

Reduce number of Kudu clients that get created

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • Impala 2.8.0
    • Impala 2.10.0
    • Backend

    Description

      Creating Kudu clients is very expensive as each will fetch metadata from the Kudu master. We can reduce the load on the Kudu master by reusing Kudu clients when possible. To start, we can use a single client for the entire BE and another for the entire FE.

      This is dependent on a metadata invalidation improvement from Kudu (https://gerrit.cloudera.org/#/c/6719/)

      Attachments

        Issue Links

          Activity

            People

              twmarshall Thomas Tauber-Marshall
              mjacobs Matthew Jacobs
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: