Bulk Operation

HDDS-6462 UnsupportedOperationException when there are more replication tasks than limit

HDDS-6462 Create acceptance test for offline recovery

HDDS-6462 Split EC acceptance tests

HDDS-6462 Use empty BufferPool for EC reconstruction

HDDS-6462 Defer non-critical partial EC reconstruction

HDDS-6462 EC: Avoid unbounded pipeline creation if all existing pipelines don't meet criteria

HDDS-6462 EC: Avoid O(n) array.remove(element) when filtering pipelines in WritableECContainerProvider

HDDS-6462 Optimize getting open pipelines from pipelineManager

HDDS-6462 Allow more EC pipelines based on number of volumes

HDDS-6462 TestContainerCommandsEC should close ECReconstructionCoordinator

HDDS-6462 EC: Validate replication config at server-side

HDDS-6462 ECReconstructionCoordinator is not closed

HDDS-6462 EC: Change ContainerReplicaPendingOps to store deadline rather than scheduled time

HDDS-6462 [EC] Reconstruction is failing with IndexOutOfBoundsException

HDDS-6462 EC: ECPipelineProvider.createForRead should filter out dead replicas and sort replicas

HDDS-6462 EC: ECBlockReconstructedStripeInputStream should check for spare replicas before failing an index

HDDS-6462 EC: ECBlockInputStream should try spare replicas on error

HDDS-6462 EC: Add normal and low priority to replication supervisor and commands

HDDS-6462 EC: Remove ECReconstructionSupervisor and send reconstruction commands to ReplicationSupervisor

HDDS-6462 java.lang.IllegalArgumentException: ECContainerReconstructionThread

HDDS-6462 EC: Refactor ReplicationSupervisor to allow Replication and Reconstruction tasks

HDDS-6462 EC: GetChecksum for EC files can fail intermittently with IndexOutOfBounds exception

HDDS-6462 EC: ReplicationManager - Use placementPolicy.replicasToRemoveToFixOverreplication in EC Over replication handler

HDDS-6462 EC: Increase the information in the RM sending command log message

HDDS-6462 EC: Verify unrecoverable EC containers which are empty transition to deleting

HDDS-6462 EC: ECContainerReplicaCount should handle pending delete of unhealthy replicas

HDDS-6462 EC: SCM unregistered event handler for DatanodeCommandCountUpdated

HDDS-6462 EC: Enhance datanode reconstruction log message

HDDS-6462 MisReplicationHandler does not consider QUASI_CLOSED replicas as sources

HDDS-6462 EC metrics related to replication commands don't add up

HDDS-6462 EC: "Missing" EC containers with some remaining replicas may block decommissioning

HDDS-6462 EC: ReplicationManager - merge mis-rep queue into under replicated queue

HDDS-6462 EC: Add debug logging to the Replication Manager check handlers

HDDS-6462 EC: Bug fix for calculating Misreplication Count

HDDS-6462 EC: Refactor Unhealthy Replicated Processor

HDDS-6462 Add subscription mechanism to ContainerReplicaPendingOps

HDDS-6462 Add a handler for over replicated Ratis containers to RM

HDDS-6462 ECUnderReplicationHandler does not consider pending adds when finding targets

HDDS-6462 Add a handler for under replicated Ratis containers in RM

HDDS-6462 Placement Policy Interface changes to handle Overreplication

HDDS-6462 Test in ec/ozonefs.robot is not executed in CI

HDDS-6462 Refactor DefaultReplicationConfig

HDDS-6462 Eliminate duplicated config in LegacyReplicationManager

HDDS-6462 EC: ReplicationManager - remove calls to ECHealthCheck from under and over replication processing

HDDS-6462 EC: ReplicationManager - refactor logic to send datanode commands into a central place

HDDS-6462 EC: Misreplication Handler changes for Placement Policy interface changes

HDDS-6462 Extend Placement Policy Interface to select mis-replicated replicas to copy

HDDS-6462 EC: ReplicationManager: Move Mis-Replicated into a separate unhealthy state

HDDS-6462 EC: Fix the NSSummaryEndpoint#getDiskUsage should be fixed for EC keys

HDDS-6462 EC: Notify ReplicationManager when a heartbeat updates datanode command counts

HDDS-6462 EC: Fix Reconstruction Issue with StaleRecoveringContainerScrubbingService

HDDS-6462 EC: Block allocation should not be stripped across the EC group

HDDS-6462 EC: ReplicationManager - implement deleting container handler

HDDS-6462 Cannot set bucket args when the volume has quota set

HDDS-6462 EC: Close pipelines with unregistered nodes

HDDS-6462 EC: SCM should throttle the reconstruction/replication tasks.

HDDS-6462 EC: EC Decode can fail when byteBuffer from elastic pool is larger than chunksize

HDDS-6462 EC: ECBlockReconstructedStripeInputStream should set initialized false on re-init

HDDS-6462 Fixing exception handling in case of non positive replica index

HDDS-6462 EC: Fix tests for HealthCheck handlers of RM that use Replica Indexes for Ratis Containers

HDDS-6462 Add a handler for Quasi Closed containers to RM

HDDS-6462 du command does not return correct disk consumed with replica for both ratis and EC

HDDS-6462 EC: Reconstruction could fail with orphan blocks.

HDDS-6462 EC: Add a Handler for CLOSING containers in Replication Manager

HDDS-6462 Add Ratis tests for HealthCheck handlers of Replication Manager

HDDS-6462 EC: ReplicationManager - Encapsulate the under and over rep queues into a queue object

HDDS-6462 Erasure coding and encryption are not flagged on FileStatus

HDDS-6462 EC: Change the placement policy interface to allow existing nodes to be specified.

HDDS-6462 EC: Schedule UnderReplicatedProcessor and OverReplicatedProcessor threads in RM instead of StorageContainerManager

HDDS-6462 EC: Enable balancer for EC containers.

HDDS-6462 EC: ReplicationManager - create handlers to perform various container checks

HDDS-6462 EC: Retry failed writes before rewrite to a new block group

HDDS-6462 EC produces some unknown 1MB blocks without the control of deleting service

HDDS-6462 EC: Add validation for EC chunk size

HDDS-6462 EC: ReplicationManager - handle UNHEALTHY replicas

HDDS-6462 EC: Offline Recovery with simultaneous Over Replication & Under Replication

HDDS-6462 EC: delete empty closed EC container

HDDS-6462 EC: ReplicationManager - UnderRep handler should handle duplicate indexes

HDDS-6462 EC: Offline reconstruction needs better logging

HDDS-6462 EC: Fix block deletion not allowed due to missing pipelineID

HDDS-6462 EC - ReplicationManager - handle maintenance only indexes in the under replication handler

HDDS-6462 EC: ReplicationManager - Track nodes already used when handing under replication

HDDS-6462 EC: Prematurely re-throwed the exception in reconstruction cleanup loop.

HDDS-6462 Exception in Replication Monitor Thread: java.lang.IllegalArgumentException

HDDS-6462 EC: ReplicationManager - Implement ratis container health checker

HDDS-6462 EC: ReplicationManager - Over replication handler should set repIndex on delete cmds

HDDS-6462 EC: Ensure replica index is maintained when replicating a container

HDDS-6462 NPE in ec.reconstruction.TokenHelper

HDDS-6462 EC: Fix offset Condition in ECKeyOutputStream

HDDS-6462 EC: Add debug logging with exception info when stripe write failed

HDDS-6462 EC: Add a tool to schedule the EC Offline Reconstruction at any node.

HDDS-6462 EC: Handle the placement policy check in ECUnderReplicationHandler

HDDS-6462 EC: DN reported Open EC container may not get closed if SCM container was already closed state?

HDDS-6462 EC: ReplicationManager - skip processing open containers

HDDS-6462 EC: Implement the Over replication Processor

HDDS-6462 EC: Add Test for RECOVERING container cleanup when failure.

HDDS-6462 EC : support EC stripe shuffle

HDDS-6462 EC: Implement RECOVERING Container Scrubber.

HDDS-6462 EC: Attempt to cleanup the RECOVERING container when reconstruction failed at coordinator.

HDDS-6462 EC: Cleanup RECOVERING container on DN restarts.

HDDS-6462 EC: Remove references to ContainerReplicaPendingOps in TestECContainerReplicaCount

HDDS-6462 EC: Define the value of Maintenance Redundancy for EC containers

HDDS-6462 EC: Add EC block checksum computer

HDDS-6462 EC: Ensure DatanodeAdminMonitor can handle EC containers during decommission

HDDS-6462 EC: Handle maintenance replicas in ECUnderReplicationHandler

HDDS-6462 EC: Handle the placement policy satisfaction in HealthChecks handling

HDDS-6462 EC: Implement the Over-replication Handler

HDDS-6462 EC: ReplicationManager - priortise under replicated containers

HDDS-6462 EC: EC Reconstruction Command count queues should be included in DN heartbeat

HDDS-6462 EC: Handle reconstructECContainersCommand in heartbeat

HDDS-6462 EC: Skip the EC container for balancer

HDDS-6462 [Ozone EC] remove warnings and errors from console during online reconstruction of data.

HDDS-6462 EC: ReplicationManager - Add relevant metrics to the various ReplicationManager classes

HDDS-6462 EC: ReplicationManager - Logic to process the over replicated queues and assign work to DNs

HDDS-6462 EC: ReplicationManager - Add class to handle under-replication and form a command for a datanode

HDDS-6462 EC: ReplicationManager - move the empty container handling into RM from Legacy

HDDS-6462 EC: ReplicationManager - extend EC Container health check for mis-replication

HDDS-6462 EC: Fix potential wrong replica read with over-replicated container.

HDDS-6462 EC: put key command with EC replication can use ReplicationConfig validator

HDDS-6462 EC: Analyze and add the block token support for ECReconstructionCoordinator

HDDS-6462 EC: Validate the server default configuration on Ozone manager startup.

HDDS-6462 EC: Provide correct example for EC in ozone.server.default.replication

HDDS-6462 EC: SCMContainerPlacementRackScatter#chooseDatanodes may choose less nodes than required in unknown cases.

HDDS-6462 Need proper error message when "RATIS" replication-type is passed with EC codec

HDDS-6462 SCMContainerPlacementRackScatter should use original required node num to validate placement policy

HDDS-6462 EC: getFileCheckSum should return null EC files until ECFileChecksum implemented.

HDDS-6462 EC: Fix datanode exclusion check in client

HDDS-6462 EC: Implement the EC Reconstruction coordinator

HDDS-6462 EC: PipelineStateMap#addPipeline should not have precondition checks post db updates

HDDS-6462 EC: Analyze and add putBlock even on non writing node in the case of partial single stripe.

HDDS-6462 EC: ReplicationManager - LegacyReplicationManager should use the ContainerReplicaPendingOps service

HDDS-6462 EC: ReplicationManager - make ContainerReplicaPendingOps into a SCM service

HDDS-6462 EC: decommission compatible offline recovery

HDDS-6462 EC: DN ability to create RECOVERING containers for EC reconstruction.

HDDS-6462 EC: Add listBlock command MockDatanodeStorage for mocking in reconstruction work.

HDDS-6462 EC: ReplicationManager - create ContainerReplicaPendingOps class and integrate with ContainerManager

HDDS-6462 EC: Add EC pipeline minimum to MiniOzoneCluster

HDDS-6462 EC: ReplicationManager - refactor Legacy RM to a container health detector

HDDS-6462 EC: ReplicationManager - create version of ContainerReplicaCounts applicable to EC

HDDS-6462 EC: ReplicationManager - collect under and over replicated containers

HDDS-6462 EC: ReplicationManager - create class to form a replicate command for under replicated containers

HDDS-6462 EC: ReplicationManager - create class to detect container health issues

HDDS-6462 EC: Extend BlockReconstructedInputStreams to recover parity block buffers as well if missing

HDDS-6462 EC: Add the DN side Reconstruction Handler class.

HDDS-6462 EC: Add BlockGroupLen info as part of PutBlock in EC Writes for helping in recovery.

HDDS-6462 EC: Make ECBlockReconstructedStripeInputStream to be used by DNs as well

HDDS-6462 EC: Improve write performance by pipelining encode and flush

HDDS-6462 EC: Fix Datanode block file INCONSISTENCY during heavy load.

HDDS-6462 EC: EC pipeline records are not removed after close.

HDDS-6462 EC: Support ListBlock from CoordinatorDN

HDDS-6462 EC: Scm CheckAndRecoverECContainer command

HDDS-6462 Add a new replication manager and change the existing one to legacy

HDDS-6462 EC: Implement the EC Reconstruction Command with necessary information

HDDS-6462 EC: DN ability to create container in temp location and write blocks to it.

HDDS-6462 Support balancing EC container.

HDDS-6462 EC: Add rpc for EC recovery in replication service

HDDS-6462 EC: Add ec write channel

HDDS-6462 EC: [Refactor-2] Check and write parity cells inside handleDataWrite

HDDS-6462 EC: Add tests for erasure coding with MiniOzoneChaosCluster

HDDS-6462 EC: Refactor ECKeyOutputStream for better code reuse

HDDS-6462 EC: Standalone containers should not move to quasi closed

HDDS-6462 EC: [Code Quality] Add more tests to get closure to 100% code coverage

HDDS-6462 EC: Add EC metrics

HDDS-6462 EC: CreateBucketHandler should use ReplicationConfig Validator

HDDS-6462 EC: WritableEcContainerProvider should dynamically adjust the open container groups