Skip to content

Add --async-max-concurrent-samples to decouple fully-async generation concurrency from batch size#1677

Open
yueming-yuan wants to merge 2 commits into
mainfrom
yueming/async-max-concurrent-tasks
Open

Add --async-max-concurrent-samples to decouple fully-async generation concurrency from batch size#1677
yueming-yuan wants to merge 2 commits into
mainfrom
yueming/async-max-concurrent-tasks