Missing support for AutoGPTQ on ARM64
levkk opened this issue · comments
Seems to be caused by: PanQiWei/AutoGPTQ#373
For us to make this work, we have to downgrade to 0.3.2 or compile from source and redistribute ourselves.
postgresml / postgresml
The GPU-powered AI application database. Get your app to market faster using the simplicity of SQL and the latest NLP, ML + LLM models.