Skip to content

HDDS-15072. [SCM] Implement dynamic load-based switching to reconstruction for EC decommission#10123

Draft
jojochuang wants to merge 2 commits intoapache:masterfrom
jojochuang:HDDS-15072
Draft

HDDS-15072. [SCM] Implement dynamic load-based switching to reconstruction for EC decommission#10123
jojochuang wants to merge 2 commits intoapache:masterfrom
jojochuang:HDDS-15072

Conversation

@jojochuang
Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

HDDS-15072. [SCM] Implement dynamic load-based switching to reconstruction for EC decommission

Please describe your PR in detail:

  • Enhance ReplicationManager to calculate a Datanode's load factor using its current queue and the effective replication limit (including
    outofservice.limit.factor). Modify ECUnderReplicationHandler to dynamically switch from 1-1 replication to reconstruction when a source Datanode's load
    exceeds the threshold. Implement "source offloading" logic to ensure that when reconstruction is triggered, the SCM prefers healthy replicas on other
    nodes as sources, bypassing the bottlenecked node.

What is the link to the Apache JIRA

https://issues.apache.org/jira/browse/HDDS-15072

How was this patch tested?

Change-Id: Ifa6911e468f073ac2cc848edc3da20dc377c983c
…ction for EC decommission

Change-Id: Ie4b8662b10de5d3e73312f6b18ac825853dfd72e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant