Uploaded image for project: 'IMPALA'
  1. IMPALA
  2. IMPALA-9400 Impala Ozone Support
  3. IMPALA-10213

Handle block location for Ozone

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • Impala 4.2.0
    • Backend
    • None
    • ghx-label-10

    Description

      Currently Impala treats Ozone as a remote filesystem, similar to S3A, ADLS etc. Ozone provides block location info in its Hadoop-compatible FS implementations. Also, Ozone can be colocated with Impala daemons. It would be nice if Impala could be improved to use Ozone's location info to support locality of execution.

      Look into unit tests to validate that reads in the mini-cluster are DISK_LOCAL rather than REMOTE.

      Attachments

        Issue Links

          causes

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-11614 TestValidateMetrics.test_metrics_are_zero fails with num-missing-volume-id for Ozone

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved
          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. IMPALA-11541 Test getStorageIds for block location with Ozone

          • Major - Major loss of function.
          • Open
          relates to

          Bug - A problem which impairs or prevents the functions of the product. IMPALA-11457 Ozone parallelism reduced when backends are co-located

          • Critical - Crashes, loss of data, severe memory leak.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDDS-7065 BlockStorage interface should return IDs for getStorageIds

          • Major - Major loss of function.
          • Open

          Activity

            People

              MikaelSmith Michael Smith
              adoroszlai Attila Doroszlai
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: