mudler / LocalAI

:robot: The free, Open Source OpenAI alternative. Self-hosted, community-driven and local-first. Drop-in replacement for OpenAI running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. It allows to generate Text, Audio, Video, Images. Also with voice cloning capabilities.

Home Page:https://localai.io

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

upstream gpt4all bindings

mudler opened this issue · comments

After having a discussion with gonzochess75 from gpt4all, seems there is interest in having golang bindings upstream!

This card is to track upstreaming our bindings (mainly the high-level additional functions to bind to the inference code) so we can just contribute all upstream, and anyone can also use gpt4all in their go programs!

bindings refactored to follow more closely upstream code: updated in LocalAI #142.

There is still something off that needs to be investigated - I had to build the example in the go-gpt4all-j repo first to build successfully.

there are still some issues with it - downgrading for now #149

Issues above fixed, for reference, PR in nomic-ai/gpt4all#534