hegelai / prompttools

Open-source tools for prompt testing and experimentation, with support for both LLMs (e.g. OpenAI, LLaMA) and vector databases (e.g. Chroma, Weaviate, LanceDB).

Home Page:http://prompttools.readthedocs.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Create generic experiments that accept a completion or chat completion function

steventkrawczyk opened this issue Β· comments

πŸš€ The feature

We need experiment classes that generalize the OpenAI experiments to any OpenAI compatible API.

Motivation, pitch

We can use this to support any completion or chat completion APIs that are compatible with the OpenAI API.

Alternatives

No response

Additional context

No response