SparkJiao

LLMSanitize

An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).

SWE-bench

[ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?

OpenDevin

🐚 OpenDevin: Code Less, Make More

code_contests

ao

Create and integrate high-performance custom data types, layouts and kernels with up to 2x speedups with 65% less VRAM for inference and support for training

apps

APPS: Automated Programming Progress Standard (NeurIPS 2021)

grok-1

Grok open release

transformer-debugger

DeepSeek-VL

DeepSeek-VL: Towards Real-World Vision-Language Understanding

DenseSSM

A repository for DenseSSMs

Inflection-Benchmarks

Public Inflection Benchmarks

GaLore

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

llm-planning-eval

Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"

UNK-VQA

A VQA dataset that includes unanswerable questions.

RLMEC

The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"

ChunkLlama

[ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

zero-bubble-pipeline-parallelism

Zero Bubble Pipeline Parallelism

dpo-trajectory-reasoning

Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".

nanotron

Minimalistic large language model 3D-parallelism training

gemma_pytorch

The official PyTorch implementation of Google's Gemma models

RefGPT

Qwen2

Qwen2 is the large language model series developed by Qwen team, Alibaba Cloud.

dspy

DSPy: The framework for programming—not prompting—foundation models

SeaEval

NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning

OLMo

Modeling, training, eval, and inference code for OLMo

mergekit

Tools for merging pretrained large language models.

HallusionBench

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

SimulateBench

GPT as Human

DeepSeek-MoE

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models