AutoAWQ Kernels is a new package that is split up from the main repository in order to avoid compilation times.
- Windows: Must use WSL2.
- GPU: Must be compute capability 7.5 or higher.
- CUDA Toolkit: Must be 11.8 or higher.
pip install autoawq-kernels
git clone https://github.com/casper-hansen/AutoAWQ_kernels
cd AutoAWQ_kernels
pip install -e .