Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7516

Add capacity control over queries running on Spark cluster [Spark Branch]

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • Spark
    • None

    Description

      Add a capacity control mechanism in Hive to limit the number queries running on Spark concurrently which might overwhelm the cluster. Idea can be borrowed from Tez.

      Attachments

        Issue Links

          is blocked by

          Sub-task - The sub-task of the issue HIVE-7593 Instantiate SparkClient per user session [Spark Branch]

          • Major - Major loss of function.
          • Resolved
          is part of

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-7292 Hive on Spark

          • Major - Major loss of function.
          • Resolved
          is related to

          Sub-task - The sub-task of the issue HIVE-7768 Integrate with Spark executor scaling [Spark Branch]

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          relates to

          Task - A task that needs to be done. HIVE-7606 Design SparkSession, SparkSessionManager [Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              vkorukanti Venki Korukanti
              xuefuz Xuefu Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: