SparkJiao

grok-1

Grok open release

OpenDevin

🐚 OpenDevin: Code Less, Make More

dspy

DSPy: The framework for programming—not prompting—foundation models

Qwen2

Qwen2 is the large language model series developed by Qwen team, Alibaba Cloud.

gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

gemma_pytorch

The official PyTorch implementation of Google's Gemma models

OLMo

Modeling, training, eval, and inference code for OLMo

mergekit

Tools for merging pretrained large language models.

transformer-debugger

code_contests

DeepSeek-VL

DeepSeek-VL: Towards Real-World Vision-Language Understanding

SWE-bench

[ICLR 2024] SWE-Bench: Can Language Models Resolve Real-world Github Issues?

GaLore

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

nanotron

Minimalistic large language model 3D-parallelism training

DeepSeek-MoE

DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Models

ao

Custom data types and layouts for training and inference

apps

APPS: Automated Programming Progress Standard (NeurIPS 2021)

ChunkLlama

[ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"

zero-bubble-pipeline-parallelism

Zero Bubble Pipeline Parallelism

HallusionBench

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

DenseSSM

A repository for DenseSSMs

RefGPT

Inflection-Benchmarks

Public Inflection Benchmarks

llm-planning-eval

Code and data of paper "When is Tree Search Useful for LLM Planning? It Depends on the Discriminator"

LLMSanitize

An open-source library for contamination detection in NLP datasets and Large Language Models (LLMs).

dpo-trajectory-reasoning

Source code for the paper "Learning Planning-based Reasoning with Trajectory Collection and Process Rewards Synthesizing".

SeaEval

NAACL 2024: SeaEval for Multilingual Foundation Models: From Cross-Lingual Alignment to Cultural Reasoning

SimulateBench

GPT as Human

RLMEC

The official repository of "Improving Large Language Models via Fine-grained Reinforcement Learning with Minimum Editing Constraint"

UNK-VQA

A VQA dataset that includes unanswerable questions.