Haoxiang-Wang

LLaMA-Factory

A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs

NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

trl

Train transformer language models with reinforcement learning.

mistral-src

Reference implementation of Mistral AI 7B v0.1 model.

LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

llama-recipes

Scripts for fine-tuning Llama2 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization & question answering. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment.Demo apps to showcase Llama2 for WhatsApp & Messenger

mmsegmentation

OpenMMLab Semantic Segmentation Toolbox and Benchmark.

axolotl

Go ahead and axolotl questions

lm-evaluation-harness

A framework for few-shot evaluation of language models.

Otter

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

opencompass

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

chain-of-thought-hub

Benchmarking large language models' complex reasoning ability with chain-of-thought prompting

ml-fastvit

This repository contains the official implementation of the research paper, "FastViT: A Fast Hybrid Vision Transformer using Structural Reparameterization" ICCV 2023

GroupViT

Official PyTorch implementation of GroupViT: Semantic Segmentation Emerges from Text Supervision, CVPR 2022.

geotorch

Constrained optimization toolkit for PyTorch

tensor_parallel

Automatically split your PyTorch models on multiple GPUs for training & inference

unified-io-2

panopticapi

COCO 2018 Panoptic Segmentation Task API (Beta version)

doremi

Pytorch implementation of DoReMi, a method for optimizing the data mixture weights in language modeling datasets

prometheus

[ICLR 2024 & NeurIPS 2023 WS] An Evaluator LM that is open-source, offers reproducible evaluation, and inexpensive to use. Specifically designed for fine-grained evaluation on a customized score rubric, Prometheus is a good alternative for human evaluation and GPT-4 evaluation.

FLASK

[ICLR 2024 Spotlight] FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Sets

easse

Easier Automatic Sentence Simplification Evaluation

RAFA_code

mint-bench

Official Repo for ICLR 2024 paper MINT: Evaluating LLMs in Multi-turn Interaction with Tools and Language Feedback by Xingyao Wang*, Zihan Wang*, Jiateng Liu, Yangyi Chen, Lifan Yuan, Hao Peng and Heng Ji.

BabyLlama

Training code for Baby-Llama, our submission to the strict-small track of the BabyLM challenge.

Skill-Localization-by-grafting

clippy

Perceptual Grouping in Contrastive Vision-Language Models (ICCV'23)

understanding-forgetting

Understanding Catastrophic Forgetting in Language Models via Implicit Inference

GOAT