alxspiker / Maid

Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models.

Maid - Mobile Artificial Intelligence Distribution

Maid is a cross-platform Flutter app for interfacing with GGUF / Llama models.

Works on multiple devices :

Windows, Linux, Android. Releases page. MacOS and IOS Releases not available at this time.

Usage

To use this app, follow these steps:

1. Download the GGUF model from your chosen source.
2. Launch maid.
3. Navigate to the settings page by opening the sidebar and pressing the settings button.
4. Click load model and select and your model file.
5. (Optionally) Set the preprompt and alias
6. Navigate back to the Home Page
7. Enter a prompt

Help Wanted

• Add ability to import sillytavern character cards
• Fix issue with models being cached
• Seperate Desktop UI from Mobile UI
• Testing and Building on MacOS and IOS

Testing

Android version tested on a Oneplus 10 Pro 11gb phone. Also tested on Debian Linux, Windows 11. Tested with llama 2 7B-Chat and llama 7B.

Disclaimer

Please note that the llama.cpp models are owned and officially distributed by Meta. This app only serves as an environment for the model's capabilities and functionality. The developers of this app do not provide the LLaMA models and are not responsible for any issues related to their usage.