VMironiuk / enchanted

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Enchanted banner Swift Release Stars iOS iOS

Enchanted

Enchanted is open source, Ollama compatible, elegant macOS/iOS/iPad app for working with privately hosted models such as Llama 2, Mistral, Vicuna, Starling and more. It's essentially ChatGPT app UI that connects to your private models. The goal of Enchanted is to deliver a product allowing unfiltered, secure, private and multimodal experience across all of your devices in iOS ecosystem (macOS, iOS, Watch, Vision Pro).

If you like the project, consider leaving a ⭐️ and following on 𝕏.

App Store

Note: You will need to run your own Ollama server to use the app. Read instructions below.

Demo

Features

  • Supports latest Ollama Chat API
  • Conversation history included in the API calls
  • Dark/Light mode
  • Conversation history is stored on your device
  • Markdown support (nicely displays tables/lists/code blocks)
  • Voice prompts
  • Image attachments for prompts
  • Specify system prompt used for every conversations
  • Edit message content or submit message with different model
  • Delete single conversation / delete all conversations
  • macOS Spotlight panel Ctrl++K

Coming soon

  • RAG (talk with your files)
  • Download new models using UI
  • Conversation syncing between devices
  • Multiple conversation for macOS

Usage instructions

Enchanted requires Ollama v0.1.14 or later.

Case 1. You run Ollama server with public access

  1. Download Enchanted app from the App Store.
  2. In App Setings specify your server endpoint.

You're done! Make a prompt.

Case 2. You run Ollama on your computer

Video instructions here

  1. Start Ollama server and download models for usage.

  2. Install ngrok forward your Ollama server to make it accessible publicly

    ngrok http 11434 --host-header="localhost:11434"
  3. Copy "Forwarding" URL that will look something like https://b377-82-132-216-51.ngrok-free.app. Your Ollama server API is now accessible through this temporary URL.

  4. Download Enchanted app from the App Store.

  5. In App Setings specify your server endpoint.

    You're done! Make a prompt.

Contact

For any questions please do not hesitate to contact me at augustinas@subj.org

About

Enchanted is iOS and macOS app for chatting with private self hosted language models such as Llama2, Mistral or Vicuna using Ollama.

License:Apache License 2.0


Languages

Language:Swift 100.0%