[CORE] Prompt Embeddings Support for v1 Engine#24278

Merged

DarkLight1337 merged 76 commits intovllm-project:mainfrom

protopia-ai:enable-prompt-embeds-in-v1

Sep 19, 2025

Commits on Aug 7, 2025

feat: :sparkles: do not fall back to v0 engine when enabling prompt embeds
qthequartermasterman
committed

Commits on Aug 8, 2025

feat: :pipe: propagate prompt_embeds from the requests to the model executors in v1 engine
qthequartermasterman
committed

Commits on Aug 14, 2025

refactor: :recycle: :truck: move length_from_prompt_tokens_or_embeds to utils
qthequartermasterman
committed
fix: keep track of prompt embeds within input batch
qthequartermasterman
committed
fix: use placeholder prompt_token_ids in RequestOutput when using prompt embeds
qthequartermasterman
committed
feat: pass prompt embeds from InputBatch to GPU model runner
qthequartermasterman
committed
fix: correctly place the correct indices
qthequartermasterman
committed
Remove accidental file
qthequartermasterman
committed

Commits on Aug 28, 2025

Commits on Sep 3, 2025

Commits on Sep 4, 2025

Commits on Sep 5, 2025

Commits on Sep 10, 2025

Commits on Sep 13, 2025

Commits on Sep 16, 2025

Commits on Sep 17, 2025

Commits on Sep 18, 2025