Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-10561

Add support for spilling to GCS

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Reopened
    • Major
    • Resolution: Unresolved
    • None
    • None
    • Backend, Catalog
    • None
    • ghx-label-9

    Description

      After IMPALA-7712 and IMPALA-9828 are resolved, we can add support for spilling to GCS as well. Maybe few code changes are needed. We need to figure out the corresponding options for GCS connections similar to "fs.s3a.fast.upload" and "fs.s3a.fast.upload.buffer" for S3 connections. Also need to add tests and metrics.

      Attachments

        Issue Links

          is duplicated by

          New Feature - A new feature of the product, which has yet to be developed. IMPALA-10560 Add support for spilling to GCS

          • Major - Major loss of function.
          • Resolved
          relates to

          Epic - Created by Jira Software - do not edit or delete. Issue type for a big user story that needs to be broken down. IMPALA-9828 Add support for spilling to Remote Storage

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. IMPALA-7712 Impala read from and write to GCS

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              stigahuang Quanlong Huang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: