python client can not be used.

[OpenJarvisAI]

Since

client = OpenAI(
        api_key="sk-fwref", base_url=base_url
    )

    a = client.models.list()

the Client will call base_url model list inside to connect, but it cannot return a response, how to make it work with python client?

[Vincent Young]

import openai

openai.api_key = 'anything'
openai.base_url = "http://localhost:3040/v1/"

completion = openai.chat.completions.create(
	model="gpt-3.5-turbo",
	messages=[
		{"role": "user", "content": "Hello"},
	],
)

print(completion.choices[0].message.content)