Skip to content

Conversation

@bjmsong
Copy link

@bjmsong bjmsong commented Dec 31, 2024

add vllm params kv_cache_dtype, quantization_param_path

@CLAassistant
Copy link

CLA assistant check
Thank you for your submission! We really appreciate it. Like many open source projects, we ask that you sign our Contributor License Agreement before we can accept your contribution.
You have signed the CLA already but the status is still pending? Let us recheck it.

@StellaAthena
Copy link
Member

Can you elaborate on why the **kwargs argument doesn't handle this? It looks like it should to me.

@bjmsong bjmsong closed this by deleting the head repository Feb 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants