This repository was archived by the owner on Sep 4, 2025. It is now read-only.
Sync release with main #230
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Signed-off-by: Max de Bayser <[email protected]>
…lm-project#8909) Co-authored-by: DarkLight1337 <[email protected]>
…ty token_ids (vllm-project#9034) Co-authored-by: Nick Hill <[email protected]>
Co-authored-by: sanghol <[email protected]> Co-authored-by: Roger Wang <[email protected]> Co-authored-by: Roger Wang <[email protected]>
…ls (vllm-project#9412) Co-authored-by: DarkLight1337 <[email protected]>
…project#9267) Signed-off-by: Russell Bryant <[email protected]>
sync with upstream @ v0.6.3.post1
libraries these are included in the python venv at /opt/vllm (torch install) so we can get rid of them.
… retrieving device information This prevents the spamming in the logs of `amdgpu.ids: No such file or directory`
this makes sure that the shared libraries in the python venv are found by the linker.
|
Skipping CI for Draft Pull Request. |
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: dtrifiro The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
groenenboomj
pushed a commit
that referenced
this pull request
Feb 24, 2025
Co-authored-by: maleksan85 <[email protected]>
vaibhavjainwiz
pushed a commit
to vajain-rhods/vllm
that referenced
this pull request
Jun 4, 2025
## Description Syncing to upstream vLLM upstream tag [v0.9.0](https://github.com/vllm-project/vllm/tree/v0.9.0) This PR does *not* target any tag upstream as of now. Builds on top of: neuralmagic/nm-vllm-ent@eea2469 Git log: ``` commit 922878c (HEAD -> upstream-sync-2025-05-21-notag, nm-fork/upstream-sync-2025-05-21-notag) Merge: a6275cd 5873877 Author: Selbi Nuryyeva <[email protected]> Date: Wed May 28 16:21:22 2025 -0400 Merge tag 'v0.9.0' into upstream-sync-2025-05-21-notag commit 5873877 (tag: v0.9.0, upstream/releases/v0.9.0) Author: Michael Goin <[email protected]> Date: Tue May 27 12:05:37 2025 -0400 [Bugfix] Mistral tool calling when content is list (vllm-project#18729) Signed-off-by: mgoin <[email protected]> commit 696259c Author: Cyrus Leung <[email protected]> Date: Tue May 27 23:45:48 2025 +0800 [Core] Automatically cast multi-modal input dtype (vllm-project#18756) Signed-off-by: DarkLight1337 <[email protected]> commit 6b6d496 Author: chunxiaozheng <[email protected]> Date: Tue May 27 21:08:44 2025 +0800 optimize get_kv_cache_torch_dtype (vllm-project#18531) Signed-off-by: idellzheng <[email protected]> commit aaa4ac1 Author: cascade <[email protected]> Date: Tue May 27 05:06:34 2025 -0700 Disable prefix cache by default for benchmark (vllm-project#18639) Signed-off-by: cascade812 <[email protected]> commit 06a0338 Author: Mark McLoughlin <[email protected]> Date: Tue May 27 10:37:06 2025 +0100 [V1][Metrics] Add API for accessing in-memory Prometheus metrics (vllm-project#17010) Signed-off-by: Mark McLoughlin <[email protected]> ``` Commands ``` git fetch upstream --tags git checkout -b upstream-sync-2025-05-21-notag git merge v0.9.0 ``` ## Testing [accept-sync](https://github.com/neuralmagic/nm-cicd/actions/runs/15309901499) run Notes: couple lm-evals are failing but that's because model locations are not fully updated and some model card numbers need updating because of that. one unit test is failing due to flashinfer version. These updates will be done in a separate PR in nm-cicd repo. The merge is good to go.
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
28 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.