snowyu / amica

Amica is an open source interface for interactive communication with 3D characters with voice synthesis and speech recognition.

Amica: Your friendly personal AI

If you like our project, please give us a star ⭐ on GitHub.

Amica is an application that allows you to easily converse with 3D characters in your browser.

You can import VRM files, adjust the voice to fit the character, and generate response text that includes emotional expressions.

The various features of Amica mainly use the following technologies:

• 3D Rendering
  • three.js
• Displaying 3D characters
  • @pixiv/three-vrm
• Running Transformers in the browser
  • Transformers.js
• Speech recognition
  • Whisper
• Voice Activity Detection
  • Silero VAD
• ChatBot
  • Llama.cpp server
  • ChatGPT API (compatible with projects such as LM Studio)
  • Window.ai
  • Ollama
  • KoboldCpp
• Text-to-Speech
  • Coqui API
  • Eleven Labs API
  • Speech T5
  • OpenAI
• Vision
  • Bakllava

🛠️ Installation and running

To run this project locally, clone or download the repository.

git clone [e-mail]:semperai/amica.git

Install the required packages.

npm install

After installing the packages, start the development web server using the following command.

npm run dev

Once started, please visit the following URL to confirm that it is working properly.

http://localhost:3000

📖 Documentation

View the documentation for more information on how to configure and use Amica.

📜 History

This project originated as a fork of ChatVRM by Pixiv:

https://pixiv.github.io/ChatVRM

🔒 License

• The majority of this project is released under the MIT license as found in the LICENSE file.
• Assets such as 3D models and images are released under their authors respective licenses.

✨ Star History

🤗 Contributors