OmarMohammed88

text-generation-inference

Large Language Model Text Generation Inference

lingua-py

The most accurate natural language detection library for Python, suitable for short text and mixed-language text

WordLlama

Things you can do with the token embeddings of an LLM

Nanoflow

A throughput-oriented high-performance serving framework for LLMs

ml-engineering

Machine Learning Engineering Open Book

sglang

SGLang is a fast serving framework for large language models and vision language models.

baukit

SAELens

Training Sparse Autoencoders on Language Models

CTranslate2

Fast inference engine for Transformer models

CircuitsVis

Mechanistic Interpretability Visualizations using React

nnsight

The nnsight package enables interpreting and manipulating the internals of deep learned models.

CALM-pytorch

Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind

pyvene

Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions

LLaMA-Factory

Unified Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

llm-transparency-tool

LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/llm-transparency-tool-demo

simple-evals

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

mlmm-evaluation

Multilingual Large Language Models Evaluation Benchmark

TransformerLens

A library for mechanistic interpretability of GPT-style language models

promptfoo

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

awesome-representation-engineering

A resource repository for representation engineering in large language models

prompt2model

prompt2model - Generate Deployable Models from Natural Language Instructions

LLocalSearch

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

pyvista

3D plotting and mesh analysis through a streamlined interface for the Visualization Toolkit (VTK)

repeng

A library for making RepE control vectors

cookbook

Open-source AI cookbook

EAGLE

Official Implementation of EAGLE-1 (ICML'24) and EAGLE-2 (EMNLP'24)

Fooocus

Focus on prompting and generating

ColossalAI

Making large AI models cheaper, faster and more accessible

DeepSeek-Coder

DeepSeek Coder: Let the Code Write Itself