Zhiyu-Chen

llama_index

LlamaIndex is a data framework for your LLM applications

LLaMA-Factory

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

Open-Sora

Open-Sora: Democratizing Efficient Video Production for All

qlib

Qlib is an AI-oriented quantitative investment platform that aims to realize the potential, empower research, and create value using AI technologies in quantitative investment, from exploring ideas to implementing productions. Qlib supports diverse machine learning modeling paradigms. including supervised learning, market dynamics modeling, and RL.

RWKV-LM

RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

the-algorithm-ml

Source code for Twitter's Recommendation Algorithm

LMFlow

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

SharpWxDump

微信客户端取证，可获取用户个人信息(昵称/账号/手机/邮箱/数据库密钥(用来解密聊天记录))；支持获取多用户信息，不定期更新新版本偏移，目前支持所有新版本、正式版本

LMOps

General technology for enabling AI capabilities w/ LLMs and MLLMs

scikit-llm

Seamlessly integrate LLMs into scikit-learn.

latex_paper_writing_tips

Tips for Writing a Research Paper using LaTeX

promptbench

A unified evaluation framework for large language models

pythia

The hub for EleutherAI's work on interpretability and learning dynamics

RL4LMs

A modular RL library to fine-tune language models to human preferences

Data-Copilot

Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflow

LLM-Adapters

Code for our EMNLP 2023 Paper: "LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Models"

TencentPretrain

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

llm-app-stack

nanoT5

Fast & Simple repository for pre-training and fine-tuning T5-style models

alpaca_farm

A simulation framework for RLHF and alternatives. Develop your RLHF method without collecting human data.

openrl

Unified Reinforcement Learning Framework

OpenICL

OpenICL is an open-source framework to facilitate research, development, and prototyping of in-context learning.

ranx

⚡️A Blazing-Fast Python Library for Ranking Evaluation, Comparison, and Fusion 🐍

inseq

Interpretability for sequence generation models 🐛 🔍

HugNLP

HugNLP is a unified and comprehensive NLP library based on HuggingFace Transformer. Please hugging for NLP now!😊 HugNLP will released to @HugAILab

RLTF

Accepted by Transactions on Machine Learning Research (TMLR)

ir_measures

provides a common interface to many IR measure tools

hf-spacerini

Plug-and-play Search Interfaces with Pyserini and Hugging Face

ir-experiment-platform