Mobile-Artificial-Intelligence / maid

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.

Maid - Mobile Artificial Intelligence Distribution

Maid is an cross-platform free and open source application for interfacing with llama.cpp models locally, and with Ollama, Mistral, Google Gemini and OpenAI models remotely.

Maid supports sillytavern character cards to allow you to interact with all your favorite characters.

Cloning

Maid utilises git submodules extensively. To clone the repository, use the following command:

git clone --recursive https://github.com/Mobile-Artificial-Intelligence/maid.git

Installing Build Dependencies

To install the dependencies on fedora based systems, use the following command:

sudo dnf install -y cmake ninja-build pkg-config gtk3-devel vulkan-devel

To install the bdependencies on debian based systems, use the following command:

sudo apt-get install -y cmake ninja-build pkg-config libgtk-3-dev libvulkan-dev

Platform Support

Windows, Linux, Android. Releases page. MacOS and IOS Releases not available at this time.

Help Wanted

• Write code comments
• Documentation
• Testing and Building on MacOS and IOS
• Spreading the word
• Google Play Testing

Special Thanks and Related Projects

• davidmigloz/langchain_dart
• Mobile-Artificial-Intelligence/maid_llm

Testing

Android version tested on a Oneplus 10 Pro 11gb phone. Also tested on Fedora Linux, Windows 11. Tested with calypso 3b, orcamini 3b, llama 2 7B-Chat, llama 7B and many more.