psugihara / FreeChat

llama.cpp based AI chat app for macOS

Home Page:https://www.freechat.run

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Satellite mode

psugihara opened this issue · comments

It would be really cool to chat with my little local AIs on the go.

I'm thinking I check a box in the settings and it gives me a link to copy with a chat web UI in it. In the future, there could be a native mobile app + QR code but for now it could just be a basic web UI proof of concept.

I'd like to implement this with the smallest possible (open source) server component to relay messages. Hoping the service could be basically free via WebRTC.

I think WebRTC would be a good fit for piping messages between FreeChat running on your mac and the satellite UI. This project by @gfodor could be useful https://github.com/gfodor/p2pcf.