Skip to content

Use past_key_values to speed up multi-token target LLM Attribution#1224

Closed
vivekmig wants to merge 3 commits intometa-pytorch:masterfrom
vivekmig:switch_generate_llm
Closed

Use past_key_values to speed up multi-token target LLM Attribution#1224
vivekmig wants to merge 3 commits intometa-pytorch:masterfrom
vivekmig:switch_generate_llm

Commits

Commits on Dec 17, 2023