google / aqt

google/aqt Issues

generalized einsum or matmul api for pure jax
Updated 3 months ago
NormalFloat4 support
Updated 3 months ago
How to use it with jnp.einsum?
Updated 3 months ago1
Embedded inference or tflite compatibility on the roadmap?
Updated 4 months ago
Binary quantization?
Updated 4 months ago
Add functionality to allow QK cache quantization.
Closed 4 months ago1
Can AQT be used to calculate qk score?
Updated 5 months ago2
TypeError: dataclass() got an unexpected keyword argument 'frozen'
Closed 5 months ago2
AqtEinsum 'not enough values to unpack'
Updated 5 months ago
Implement FP8 Numerics.
Closed 6 months ago1
Test
Closed 8 months ago2
Does JAXv2 allow for arbitrary quantization?
Closed 8 months ago1
Performance of MNIST example
Closed 8 months ago1
Store quantized weights and calibration scales in the checkpoint.
Closed 8 months ago1
How to use this package to quantize a pretrained model in huggingface, such as BERT / Roberta?
Updated 9 months ago1
Implement backprop quantization for convolution.
Updated 9 months ago
Refactor config/code classes to follow Flax.
Updated 9 months ago
Port static quantization from AQTv1 to AQTv2
Updated 9 months ago
Quantized Batch Normalization?
Closed 9 months ago1
Difference between jax and jax legacy?
Closed 9 months ago1
Does this framework support "what you serve is what you train" for weight only quantization?
Closed 9 months ago5
Publish updated version?
Closed 9 months ago1
ckpt of 8-bit ResNet-50 teacher model
Closed 9 months ago1
Broken `aqtp-0.1.1` package: missing `aqt` package prefix
Closed 9 months ago1
After installation, can not import aqt.common
Closed a year ago