Context Parallelism - #446

Open

rrutmann wants to merge 18 commits into

mainfrom

Commits on May 18, 2026

feat: Implement context parallelism

rrutmann
and
Copilot
committed
ac3860c
feat: Refine integration of context parallelism

rrutmann
and
Copilot
committed
0ecdaf7

Commits on May 19, 2026

test: Fix tests
rrutmann
committed
bf31db4

Commits on May 20, 2026

refactor: Improve code quality
rrutmann
committed
9f38f1e
test: Add more tests for cp
rrutmann
committed
babcb21
fix: Fix context parallelism with RoPE
rrutmann
committed
3667352

Commits on May 21, 2026

fix: Shard batches for evaluation
rrutmann
committed
26fccf9
test: Add test configurations
rrutmann
committed
0d1910f
chore: Add missing parameter experiments_root_path
rrutmann
committed
c82d13d
chore: Add cp training configs
rrutmann
committed
991afad
test: Add tests for cp + pp
rrutmann
committed
316da1d

Commits on Jun 9, 2026

test: Add cp test configs
rrutmann
committed
88e4b80

Commits on Aug 5, 2026

fix: Select free port at runtime instead of hardcoded value

rrutmann
and
Copilot
authored
42c5831
fix: Select free port at runtime instead of hardcoded value

rrutmann
and
Copilot
authored
f808c73
fix: Capture original classmethod instead of bound method wrapper

rrutmann
and
Copilot
authored
5088aa5

Commits on Aug 6, 2026

fix: correct context parallel synchronization and positions
rrutmann
committed
33d9426
fix: propagate global positions through CP pipelines
rrutmann
committed
b2a39bd

Commits on Aug 11, 2026

test: Add missing target_key
rrutmann
committed
2f4ba60