OmarMohammed88

CircuitsVis

Mechanistic Interpretability Visualizations using React

nnsight

The nnsight package enables interpreting and manipulating the internals of deep learned models.

CALM-pytorch

Implementation of CALM from the paper "LLM Augmented LLMs: Expanding Capabilities through Composition", out of Google Deepmind

pyvene

Stanford NLP Python Library for Understanding and Improving PyTorch Models via Interventions

LLaMA-Factory

Unify Efficient Fine-Tuning of 100+ LLMs

llm-transparency-tool

LLM Transparency Tool (LLM-TT), an open-source interactive toolkit for analyzing internal workings of Transformer-based language models. *Check out demo at* https://huggingface.co/spaces/facebook/llm-transparency-tool-demo

simple-evals

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

mlmm-evaluation

Multilingual Large Language Models Evaluation Benchmark

TransformerLens

A library for mechanistic interpretability of GPT-style language models

promptfoo

Test your prompts, agents, and RAGs. Use LLM evals to improve your app's quality and catch problems. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

awesome-representation-engineering

A resource repository for representation engineering in large language models

prompt2model

prompt2model - Generate Deployable Models from Natural Language Instructions

LLocalSearch

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user can see the progress of the agents and the final answer. No OpenAI or Google API keys are needed.

pyvista

3D plotting and mesh analysis through a streamlined interface for the Visualization Toolkit (VTK)

repeng

A library for making RepE control vectors

cookbook

Open-source AI cookbook

EAGLE

Official Implementation of EAGLE

Fooocus

Focus on prompting and generating

ColossalAI

Making large AI models cheaper, faster and more accessible

DeepSeek-Coder

DeepSeek Coder: Let the Code Write Itself

alignment-handbook

Robust recipes to align language models with human and AI preferences

LLaVA

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

promptflow

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

axolotl

Go ahead and axolotl questions

LLM-Agent-Survey

Awesome-LLM-RL

A comprehensive list of PAPERS, CODEBASES, and, DATASETS on Decision Making using Foundation Models including LLMs and VLMs.

ray

An open source framework that provides a simple, universal API for building distributed applications. Ray is packaged with RLlib, a scalable reinforcement learning library, and Tune, a scalable hyperparameter tuning library.

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs