ChenxinAn-fdu

Awesome-LLM-Long-Context-Modeling

📰 Must-read papers and blogs on LLM based Long Context Modeling 🔥

LLMTest_NeedleInAHaystack

Doing simple retrieval from LLM models at various context lengths to measure accuracy

RULER

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

llama3

The official Meta Llama 3 GitHub site

OSWorld

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

MMSSL

MMSSL: Multi-Modal Self-Supervised Learning for Recommendation in WWW' 2023

Say-I-Dont-Know

[ICML'2024] Can AI Assistants Know What They Don't Know?

InfLLM

The code of our paper "InfLLM: Unveiling the Intrinsic Capacity of LLMs for Understanding Extremely Long Sequences with Training-Free Memory"

LongHeads

LongHeads: Multi-Head Attention is Secretly a Long Context Processor

Efficient-LLMs-Survey

[TMLR 2024] Efficient Large Language Models: A Survey

EMO

[ICLR 2024]EMO: Earth Mover Distance Optimization for Auto-Regressive Language Modeling(https://arxiv.org/abs/2310.04691)

Multi-LoRA-Composition

Repository for the Paper "Multi-LoRA Composition for Image Generation"

arks

LongWanjuan

Towards Systematic Measurement for Long Text Quality

ChunkLlama

[ICML'24] Data and code for our paper "Training-Free Long-Context Scaling of Large Language Models"

diffusion-of-thoughts

Code for the paper "Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models"

F-Eval

F-Eval: Asssessing Fundamental Abilities with Refined Evaluation Methods

self-infilling

[ICML 2024] Self-Infilling Code Generation

alignment-for-honesty

BooookScore

A package to generate summaries of long-form text and evaluate the coherence of these summaries. Official package for our ICLR 2024 paper, "BooookScore: A systematic exploration of book-length summarization in the era of LLMs".

XoT

EMNLP 2023 Plan, Verify and Switch: Integrated Reasoning with Diverse X-of-Thoughts

LongLoRA

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

OpenAgents

OpenAgents: An Open Platform for Language Agents in the Wild

ParaKnowTransfer

Code for "Seeking Neural Nuggets: Knowledge Transfer in Large Language Models from a Parametric Perspective"

scaling-rope

code for Scaling Laws of RoPE-based Extrapolation

Lemur

[ICLR 2024] Lemur: Open Foundation Models for Language Agents

my-tools

my commonly-used tools

yarn

YaRN: Efficient Context Window Extension of Large Language Models

CLAIF

[Findings of ACL'2023] Improving Contrastive Learning of Sentence Embeddings from AI Feedback

vllm

A high-throughput and memory-efficient inference and serving engine for LLMs