Skip to content

[V0][Bugfix] Fix parallel sampling performance regression when guided decoding is enabled#17731

Merged
vllm-bot merged 5 commits intovllm-project:mainfrom
shadeMe:v0/fix/logitsprocessor-parallel-sampling-guided-decoding-deepcopy
May 23, 2025
Merged

[V0][Bugfix] Fix parallel sampling performance regression when guided decoding is enabled#17731
vllm-bot merged 5 commits intovllm-project:mainfrom
shadeMe:v0/fix/logitsprocessor-parallel-sampling-guided-decoding-deepcopy

Commits

Commits on May 6, 2025

Commits on May 7, 2025

Commits on May 13, 2025