Skip to content

feature(whl): add rlhf pipeline. #748

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
kxzxvbk wants to merge 18 commits into
base: main
Choose a base branch
from

Merge branch 'main' into rlhf

f3a8245
Select commit
Loading
Failed to load commit list.
Open

feature(whl): add rlhf pipeline. #748

Merge branch 'main' into rlhf
f3a8245
Select commit
Loading
Failed to load commit list.
Codecov / codecov/project succeeded Apr 4, 2026 in 0s

76.83% (+0.04%) compared to d7a61c2

View this Pull Request on Codecov

76.83% (+0.04%) compared to d7a61c2

Details

Codecov Report

❌ Patch coverage is 20.50473% with 252 lines in your changes missing coverage. Please review.
✅ Project coverage is 76.83%. Comparing base (d7a61c2) to head (f3a8245).
⚠️ Report is 94 commits behind head on main.

Files with missing lines Patch % Lines
ding/model/template/lm_vac.py 20.00% 92 Missing ⚠️
ding/policy/ppof.py 5.74% 82 Missing ⚠️
ding/framework/middleware/collector.py 15.62% 27 Missing ⚠️
ding/rl_utils/gae.py 11.11% 16 Missing ⚠️
ding/reward_model/language_reward_model.py 31.57% 13 Missing ⚠️
ding/bonus/ppof.py 0.00% 12 Missing ⚠️
ding/bonus/config.py 0.00% 10 Missing ⚠️
Additional details and impacted files 
@@            Coverage Diff             @@
##             main     #748      +/-   ##
==========================================
+ Coverage   76.78%   76.83%   +0.04%     
==========================================
  Files         671      674       +3     
  Lines       53196    53935     +739     
==========================================
+ Hits        40847    41440     +593     
- Misses      12349    12495     +146

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
View more details on Codecov