low-bit

There are 0 repository under low-bit topic.

intel / neural-speed
An innovative library for efficient LLM inference via low-bit quantization
cpu fp8 gaudi2 gpu int4 int8 llm-inference low-bit sparsity fp4 llm-fine-tuning mxformat nf4 llamacpp int2 int3 int5 int6 int7 int1
Language:C++ 282
fdbtrs / QuantFace
QuantFace: Towards Lightweight Face Recognition by Synthetic Data Low-bit Quantization
biometrics biometrics-facialrecognition face face-recognition low-bit quantization
Language:Python 30
pyjhzwh / low-bit-quant-admm
admm for cnn layerwise weight low bit quantization
python admm neural-network quantization low-bit
Language:Python 7

intel / neural-speed