Beast code in Giters

nyunAI's repositories

Language:PythonAGPL-3.06000

Language:Python50 30

Language:Python40 2 3

Language:Python400

Language:PythonApache-2.0000

Language:PythonAGPL-3.0000

Language:PythonAGPL-3.0000

Language:PythonAGPL-3.0000

Language:Python000

Language:Python000

Language:Python000

Language:C++Apache-2.0000

Official Pytorch repository for Extreme Compression of Large Language Models via Additive Quantization https://arxiv.org/pdf/2401.06118.pdf

Apache-2.0000

Patch for Grouped Query Attention

Language:PythonApache-2.0000

This is the official documentation for nyuntam

Language:Python000

QServe: W4A8KV4 Quantization and System Co-design for Efficient LLM Serving

Language:PythonApache-2.0000