Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
1.2.0, 1.3.0, 1.4.0
-
None
-
None
Description
Pipelines are a proxy for the degree of parallelism that can be used for writes. This is typically tuned based on number of drives. This is currently a manual config (ozone.scm.datanode.pipeline.limit and ozone.scm.ec.pipeline.minimum). SCM should have an automated way to scale up the parallelism based on the write latency seen and number of volumes configured.