agi-templar / Awesome-Small-Language-Model

A collection of good publicly available small language models.

Awesome Small Language Models 👼🏻

A curated list of open source Small Language Models.

Models

Google Gemma

Pre-trained Models: PT-2B | PT-7B

Instruction Following Models: IT-2B | IT-7B

Features:

• Open-source code (PyTorch).
• Open-source inference framework (C++)

Paper | BibTex

---

Meta LLaMA 2

Pre-trained Models: PT-7B | PT-13B | PT-70B

Chat Optimized Models: Chat-7B | Chat-13B | Chat-70B

Features:

• Iterative RLHF

Paper | BibTex

---

Meta LLaMA

Pre-trained Models: PT-7B | PT-33B | PT-65B

Paper | BibTex