-
-
Notifications
You must be signed in to change notification settings - Fork 11.2k
Closed
Labels
feature requestNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomers
Description
🚀 The feature, motivation and pitch
We need to add support for Anthropic API, at least for the /v1/messages endpoint, in order to support applications that depend on it like Claude Code.
There are routers that implement the endpoint by wrapping the OpenAI api server from vLLM, like https://github.com/musistudio/claude-code-router and https://github.com/1rgs/claude-code-proxy
I'm not sure the difficulty, but I think it shouldn't be difficult and hopefully should be able to be added as a new endpoint within vllm serve
Alternatives
No response
Additional context
No response
Before submitting a new issue...
- Make sure you already searched for relevant issues, and asked the chatbot living at the bottom right corner of the documentation page, which can answer lots of frequently asked questions.
simon-mo, ianmage, reginold, rmekdma, nikaro and 7 more
Metadata
Metadata
Assignees
Labels
feature requestNew feature or requestNew feature or requestgood first issueGood for newcomersGood for newcomers