small-models

There are 0 repository under small-models topic.

SqueezeAILab / SqueezeLLM
[ICML 2024] SqueezeLLM: Dense-and-Sparse Quantization
efficient-inference large-language-models llm model-compression natural-language-processing post-training-quantization quantization text-generation transformer llama localllm small-models
Language:Python 580
SqueezeAILab / KVQuant
KVQuant: Towards 10 Million Context Length LLM Inference with KV Cache Quantization
compression efficient-inference efficient-model large-language-models llama llm localllama localllm mistral model-compression natural-language-processing quantization small-models text-generation transformer
Language:Python 217
aitomatic / openssa
OpenSSA: Small Specialist Agents—Enabling Efficient, Domain-Specific Planning + Reasoning for AI
domain-knowledge industrial-ai small-models specialist-agents
Language:Python 150
zhangyifei01 / Awesome-Self-supervised-Learning-of-Tiny-Models
Overview of self-supervised learning of tiny models, including distillation-based methods (aks. self-supervised distillation) and non-distillation methods.
knowledge-distillation self-supervised self-supervised-distillation lightweight-models binary-neural-networks small-models tiny-models
6
sfarhat / dapt
Code for "On the Surprising Efficacy of Distillation as an Alternative to Pre-Training Small Models"
contrastive-learning distillation pre-training small-models synthetic-data
Language:Python 4
ENSTA-U2IS-AI / optuMNIST
Help us define the Pareto front of small models for MNIST classification. Frugal AI.
deep-learning deep-neural-networks frugality mnist-classification small-models
Language:Python 1