A hackish frontend for mlx-lm. Uses the mlx-community/Nous-Hermes-2-Mixtral-8x7B-DPO-4bit
model.
$ ./install.sh
$ . ./venv/bin/activate
$ streamlit run app.py
- Add "continue" function
A hackish frontend for mlx-lm using streamlit. The default model is the excellent mlx-community/Nous-Hermes-2-Mixtral-8x7B-DPO-4bit but supports other ChatML models as well
A hackish frontend for mlx-lm. Uses the mlx-community/Nous-Hermes-2-Mixtral-8x7B-DPO-4bit
model.
$ ./install.sh
$ . ./venv/bin/activate
$ streamlit run app.py
A hackish frontend for mlx-lm using streamlit. The default model is the excellent mlx-community/Nous-Hermes-2-Mixtral-8x7B-DPO-4bit but supports other ChatML models as well