Dominic789654

LLaMA-Factory

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

gpt-researcher

LLM based autonomous agent that does online comprehensive research on any given topic

MiniCPM-V

MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

bertviz

BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Conference-Acceptance-Rate

Acceptance rates for the major AI conferences

transformer-debugger

DeepSeek-V2

DeepSeek-V2: A Strong, Economical, and Efficient Mixture-of-Experts Language Model

mistral-finetune

self-rag

This includes the original implementation of SELF-RAG: Learning to Retrieve, Generate and Critique through self-reflection by Akari Asai, Zeqiu Wu, Yizhong Wang, Avirup Sil, and Hannaneh Hajishirzi.

S-LoRA

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

lighteval

LightEval is a lightweight LLM evaluation suite that Hugging Face has been using internally with the recently released LLM data processing library datatrove and LLM training library nanotron.

RULER

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

PyramidKV

The Official Implementation of PyramidKV: Dynamic KV Cache Compression based on Pyramidal Information Funneling

aideml

AIDE: the Machine Learning CodeGen Agent

Lamini-Memory-Tuning

Banishing LLM Hallucinations Requires Rethinking Generalization

LLM-Merging

LLM-Merging: Building LLMs Efficiently through Merging

label-words-are-anchors

Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning

AutoSurvey

VisualSketchpad

Codes for Visual Sketchpad: Sketching as a Visual Chain of Thought for Multimodal Language Models

Awesome-TimeSeries-LLM-FM

The collection of resources about LLM for Time series tasks

MMLU-Pro

The scripts for MMLU-Pro

batch-prompting

[EMNLP 2023 Industry Track] A simple prompting approach that enables the LLMs to run inference in batches.

Pruner-Zero

Pruner-Zero: Evolving Symbolic Pruning Metric from scratch for LLMs

BitDistiller

[ACL 2024] A novel QAT with Self-Distillation framework to enhance ultra low-bit LLMs.

ExCP

Official implementation of ICML 2024 paper "ExCP: Extreme LLM Checkpoint Compression via Weight-Momentum Joint Shrinking".

chunk-attention

OwLore

Official Pytorch Implementation of "OwLore: Outlier-weighed Layerwise Sampled Low-Rank Projection for Memory-Efficient LLM Fine-tuning" by Pengxiang Li, Lu Yin, Xiaowei Gao, Shiwei Liu

GreenTrainer

Code for paper "Towards Green AI in Fine-tuning Large Language Models via Adaptive Backpropagation" (ICLR'24)

RLHFlow.github.io

Webpage for RLHFlow

llama-python-streamingllm