kagisearch / pyllms

Minimal Python library to connect to LLMs (OpenAI, Anthropic, AI21, Cohere, Aleph Alpha, HuggingfaceHub, Google PaLM2, with a built-in model performance benchmark.

Home Page:https://kagi.com

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Are local models supported?

vahuja4 opened this issue · comments

Not yet, we can do this as we starting to experiment with local more. Should probably be a simple way to define the function to be called to process sending/receiving stuff from the model.