Skip to content

[Bugfix] Fix max_num_batched_tokens for MLA#13620

Merged
simon-mo merged 2 commits intovllm-project:mainfrom
neuralmagic:fix-mla-prompt-len
Feb 21, 2025
Merged

[Bugfix] Fix max_num_batched_tokens for MLA#13620
simon-mo merged 2 commits intovllm-project:mainfrom
neuralmagic:fix-mla-prompt-len

Commits

Commits on Feb 20, 2025