transformerlab / transformerlab-app

Experiment with Large Language Models

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Unable to select any quantization other than 4 for MLX Exporter

dadmobile opened this issue · comments

"Hm if I want to export models I get the choices for 2, 4 and 8 bit quantization. But I can only select 4."

mlxquantize