Does prompt playground support OpenAI-API compatible LLM providers?

[qlibp]

I could use this provider via openai's lib, with http_client set to unsafe http client, i.e. unsafe_http_client = httpx.Client(verify=False)

But got a connection error when run in prompt playground. Any ideas?

[dosubot[bot]]

The prompt playground does support OpenAI-API compatible LLM providers. To resolve the connection error when using the "Qwen/Qwen2.5-72B-Instruct" model with an unsafe HTTP client, ensure that the server is configured with the correct OPENAI_BASE_URL environment variable. If you are using app.phoenix.arize.com, this may fail due to security reasons, resulting in a Connection Error. Make sure your API keys are correctly set either in the browser's local storage or as environment variables on the server side, with the browser settings taking precedence if both are configured ^[1][2].

To continue talking to Dosu, mention @dosu.

---

^{Help Dosu learn! Give it feedback: Great Response | Irrelevant Answer | Incorrect Sources | Too Verbose | Hallucination | Bug Report | Other}

[RogerHYang]

This is still puzzling, because I set SSL_CERT_FILE=xxx and stepped through the debugger running the Phoenix playground, and I did see it being picked up by the openai client at initialization. (In the screenshot below, you can see Phoenix on the call stack.)

[RogerHYang]

Do you see any error in the server log? I ran SSL_CERT_FILE=xxx phoenix serve exactly and indeed it shows file not found when I use the playground.

[qlibp]

Do you see any error in the server log? I ran SSL_CERT_FILE=xxx phoenix serve exactly and indeed it shows file not found when I use the playground.

nop, I don't see this error log.

[qlibp]

is the playground client call use python code? If so, I could debug it on myself & report them back. You could point me to some key file & key functions.

[RogerHYang]

You can place breakpoints at the following locations in your installed libraries:

• Phoenix library: playground_clients.py#L494 client = AsyncOpenAI
• httpx library: _config.py#L34 if trust_env and os.environ.get("SSL_CERT_FILE"):

[qlibp]

I also try making http request, but got no output shown up. I guess it also fail to make a successful request.

I finally have time to find out the bug. #8060

[qlibp]

Do you see any error in the server log? I ran SSL_CERT_FILE=xxx phoenix serve exactly and indeed it shows file not found when I use the playground.

This ssl method indeed works.

[RogerHYang]

Thank you for diving deep into this subtle bug. We really appreciate it! I'll look into the issue you've filed.