Skip to content

HDDS-15073. [DataNode] Add outbound replication limit per volume#10128

Draft
jojochuang wants to merge 3 commits intoapache:masterfrom
jojochuang:HDDS-15073
Draft

HDDS-15073. [DataNode] Add outbound replication limit per volume#10128
jojochuang wants to merge 3 commits intoapache:masterfrom
jojochuang:HDDS-15073

Conversation

@jojochuang
Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

HDDS-15073. [DataNode] Add outbound replication limit per volume

Please describe your PR in detail:

  • Introduce hdds.datanode.replication.volume.outbound.limit to restrict concurrent replication reads per physical disk. Add an activeOutboundReplications
    atomic counter to HddsVolume to track current disk-level load. Update OnDemandContainerReplicationSource and EC source providers to increment/decrement
    this counter during container streaming. This provides the infrastructure for disk-level fairness.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-15073

How was this patch tested?

Change-Id: Ifa6911e468f073ac2cc848edc3da20dc377c983c
…ction for EC decommission

Change-Id: Ie4b8662b10de5d3e73312f6b18ac825853dfd72e
Change-Id: Ic4e49c06f798cd4a15a630e742e17debba9b7494
(cherry picked from commit aca4193)
Copy link
Copy Markdown
Contributor Author

@jojochuang jojochuang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TODO: TestDecommissionAndMaintenance.testInsufficientNodesCannotBeDecommissioned failed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant