Smart Connections + Kobold or TextGen
Webslug opened this issue · comments
Hi there, I am using a program called Kobold.cpp to run a model locally. I decided to try Smart Connections today and I tried to connect the plugin to kobold.
Model Name: Flam
Protocol: http
hostname: localhost
Path: http://127.0.0.1:5001/v1/
I have tried various Paths but not seem to work.
127.0.0.1/api/latest/generate
http://127.0.0.1:5001/v1/
/api/v1
However when ever I try to connect it says No Smart connections found.
Does Obsidian Smart Connections work with programs like Text-Gen-UI or Kobold.CPP on locally run models?
I can't seem to get it to work and I'd rather not use OpenAI or online third party services.
Similar #556
