A bare-bones implementation of OpenAI's Laundry Buddy using open source LLMs. All jokes aside, this is just a fun playground for local models and experimentation on my 2020 M1 Macbook Air.
For the demo, I use a 4-bit quantized Rocket 3B. You can download it from here.