Skip to content

[Speculative decoding] Enable TP>1 speculative decoding#4808

Closed
cadedaniel wants to merge 15 commits intovllm-project:mainfrom
cadedaniel:tp_gt_1
Closed

[Speculative decoding] Enable TP>1 speculative decoding#4808
cadedaniel wants to merge 15 commits intovllm-project:mainfrom
cadedaniel:tp_gt_1

Commits

Commits on May 9, 2024

Commits on May 14, 2024