Skip to content

Allow max_batch_prefill_tokens to be less than max_input_length - #736

Open
ajtejankar wants to merge 1 commit into
mainfrom
default-mbpt
Open

Allow max_batch_prefill_tokens to be less than max_input_length#736
ajtejankar wants to merge 1 commit into
mainfrom
default-mbpt

allow max_batch_prefill_tokens to be less than max_input_length

33307b9
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs