MLX-VLM a package for running Vision LLMs on your Mac using MLX.
The easiest way to get started is to install the mlx-vlm package:
With pip:
pip install mlx-vlmInference:
python -m mlx_vlm.generate --model qnguyen3/nanoLLaVA --max-tokens 100 --temp 0.0