Uploaded image for project: 'Apache Ozone'
  1. Apache Ozone
  2. HDDS-10710

Automatically scale up pipelines in Ozone if there is spare capacity.

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.2.0, 1.3.0, 1.4.0
    • None
    • SCM
    • None

    Description

      Pipelines are a proxy for the degree of parallelism that can be used for writes. This is typically tuned based on number of drives. This is currently a manual config (ozone.scm.datanode.pipeline.limit and ozone.scm.ec.pipeline.minimum). SCM should have an automated way to scale up the parallelism based on the write latency seen and number of volumes configured.

      Attachments

        Activity

          People

            Unassigned Unassigned
            ritesh Ritesh Shukla
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: