examples: Langchain ChatOpenAI integration doesn't work

[benm5678]

LocalAI version:

63e1f8f

Environment, CPU architecture, OS, and Version:

AWs g5.xlarge (single A10)

Describe the bug

It seems langchain's ChatOpenAI expects <base_url>/engines/<model_name>/chat/completions to respond, but doesn't seem LocalAI exposes that -- I tried your example code and it has the same issue: https://github.com/mudler/LocalAI/blob/master/examples/langchain/langchainpy-localai-example/full_demo.py

To Reproduce

Try the langchain example code

Expected behavior

Langchain's ChatOpenAI should work just by setting the base url to LocalAI (e.g. http://local-ai-host:8080/v1)

Logs

Error from langchain: openai.error.InvalidRequestError: Cannot POST /v1/engines/thebloke__llama2-chat-ayt-13b-gguf__llama2-chat-ayt-13b.q5_k_s.gguf/chat/completions

Error in LocalAI debug: [127.0.0.1]:34992 404 - POST /v1/engines/thebloke__llama2-chat-ayt-13b-gguf__llama2-chat-ayt-13b.q5_k_s.gguf/chat/completions

Additional context

This is the output of our /models endpoint in LocalAI: {"object":"list","data":[{"id":"thebloke__llama2-chat-ayt-13b-gguf__llama2-chat-ayt-13b.q5_k_s.gguf","object":"model"}]}

Calling it with this curl command works: curl http://localhost:8000/v1/chat/completions -H "Content-Type: application/json" -d '{ "model": "thebloke__llama2-chat-ayt-13b-gguf__llama2-chat-ayt-13b.q5_k_s.gguf", "messages": [{"role": "user", "content": "hi"}], "temperature": 0.9 }'

[mudler]

the example is outdated and needs some love. did you installed the requirements with pip?

[benm5678]

the example is outdated and needs some love. did you installed the requirements with pip?

The langchain version is very outdated in requirements... so no, I'm using the latest Langchain (0.0.354). I did a quick hack for now to fix it in api.go by adding this line app.Post("/v1/engines/:model/chat/completions", auth, openai.ChatEndpoint(cl, options))

[benm5678]

Sorry, it was my mistake... you are right, as mentioned in another issue I was using an outdated openai package.