Bannng

grok-1

Grok open release

gpt-2

Code for the paper "Language Models are Unsupervised Multitask Learners"

generative_agents

Generative Agents: Interactive Simulacra of Human Behavior

Mos

一个用于在 macOS 上平滑你的鼠标滚动效果或单独设置滚动方向的小工具, 让你的滚轮爽如触控板 | A lightweight tool used to smooth scrolling and set scroll direction independently for your mouse on macOS

mistral-inference

Official inference library for Mistral models

FlagEmbedding

Retrieval and Retrieval-augmented LLMs

LLMLingua

To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.

mergekit

Tools for merging pretrained large language models.

rant3

(Obsolete) Archive of Rant 3.x.

finetune-transformer-lm

Code and model for the paper "Improving Language Understanding by Generative Pre-Training"

generative-ai-docs

Documentation for Google's Gen AI site - including the Gemini API and Gemma

deduplicate-text-datasets

PyTorch

Deep Learning Zero to All - Pytorch

booknlp

BookNLP, a natural language processing pipeline for books

concordia

A library for generative social simulation

narrativeqa

This repository contains the NarrativeQA dataset. It includes the list of documents with Wikipedia summaries, links to full stories, and questions and answers.

NEFTune

Official repository of NEFTune: Noisy Embeddings Improves Instruction Finetuning

Persona-Dialogue-Generation

The code of ACL 2020 paper "You Impress Me: Dialogue Generation via Mutual Persona Perception"

Selective_Context

Compress your input to ChatGPT or other LLMs, to let them process 2x more content and save 40% memory and GPU time.

FActScore

A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"

cartography

Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics

Poly-Encoder

doc-story-generation

LLM-SLERP-Merge

Spherical Merge Pytorch/HF format Language Models with minimal feature loss.

ff-layers

The accompanying code for "Transformer Feed-Forward Layers Are Key-Value Memories". Mor Geva, Roei Schuster, Jonathan Berant, and Omer Levy. EMNLP, 2021.

ICTC

This is a public repository for Image Clustering Conditioned on Text Criteria (IC|TC)

long_tail_knowledge

Repo for the paper "Large Language Models Struggle to Learn Long-Tail Knowledge"

doc-storygen-v2

Codebase for LLM story generation; updated version of https//github.com/yangkevin2/doc-story-generation

mambaformer-icl

MambaFormer in-context learning experiments and implementation for https://arxiv.org/abs/2402.04248

fim-pretraining

Fill-in-the-Middle Pre-training of Large Language Models in pure PyTorch!