Skip to content

Add --async-max-concurrent-samples to decouple fully-async generation concurrency from batch size#1677

Open
yueming-yuan wants to merge 2 commits into
mainfrom
yueming/async-max-concurrent-tasks
Open

Add --async-max-concurrent-samples to decouple fully-async generation concurrency from batch size#1677
yueming-yuan wants to merge 2 commits into
mainfrom
yueming/async-max-concurrent-tasks

fully_async: drop dead AsyncRolloutWorker.concurrency; assert concurr…

ca751f8
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar