rmihaylov

fiddler

Fast Inference of MoE Models with CPU-GPU Orchestration

llm-autoeval

Automatically evaluate your LLMs in Google Colab

lm-evaluation-harness

A framework for few-shot evaluation of language models.

falcontune

Tune any FALCON in 4-bit

mpttune

Tune MPTs

landmark-attention