Dereck0602

Awesome-LLM-Compression

Awesome LLM compression research papers and tools.

llama-pipeline-parallel

A prototype repo for hybrid training of pipeline parallel and distributed data parallel with comments on core code snippets. Feel free to copy code and launch discussions about the problems you have encoured.

GEAR

GEAR: An Efficient KV Cache Compression Recipefor Near-Lossless Generative Inference of LLM

Quest

[ICML 2024] Quest: Query-Aware Sparsity for Efficient Long-Context LLM Inference

DejaVu

ZO-LLM

[ICML 2024] Official code for the paper "Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark ".

sparse_gpu_operator

GPU operators for sparse tensor operations

FlagGems

FlagGems is an operator library for large language models implemented in Triton Language.

LLM-Viewer

Analyze the inference of Large Language Models (LLMs). Analyze aspects like computation, storage, transmission, and hardware roofline model in a user-friendly interface.

awesome-representation-engineering

A resource repository for representation engineering in large language models

open-box

Generalized and Efficient Blackbox Optimization System

OpenBA-v2

OpenBA-V2: 3B LLM (Large Language Model) with T5 architecture, utilizing model pruning technique and continuing pretraining from OpenBA-15B.

Awesome-LLM-System-Papers

TriForce

[COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

Pruning-LLMs

The framework to prune LLMs to any size and any config.

GaLore

GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

LLaMA-Factory

A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

mintaka

Dataset from the paper "Mintaka: A Complex, Natural, and Multilingual Dataset for End-to-End Question Answering" (COLING 2022)

KG_RAG

Empower Large Language Models (LLM) using Knowledge Graph based Retrieval-Augmented Generation (KG-RAG) for knowledge intensive tasks

Awesome-Knowledge-Graph-Reasoning

AKGR: Awesome Knowledge Graph Reasoning is a collection of knowledge graph reasoning works, including papers, codes and datasets

DetIE

The code for the paper 'DetIE: Multilingual Open Information Extraction Inspired by Object Detection' by Vasilkovsky et al.

llama_index

LlamaIndex is a data framework for your LLM applications

rpca

Python implementation of robust principal component analysis

godec

Python implementation of the GoDec algorithm from Zhou and Tao (ICML 2011) for low-rank and sparse representation

lion-pytorch

🦁 Lion, new optimizer discovered by Google Brain using genetic algorithms that is purportedly better than Adam(w), in Pytorch

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

awesome-instruction-dataset

A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

Conference-Accepted-Paper-List

Some Conferences' accepted paper lists (including AI, ML, Robotic)

LLM-Pruner

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

chain-of-thought-hub

Benchmarking large language models' complex reasoning ability with chain-of-thought prompting