Long Zhao's starred repositories
FlagEmbedding
Retrieval and Retrieval-augmented LLMs
generative-recommenders
Repository hosting code used to reproduce results in "Actions Speak Louder than Words: Trillion-Parameter Sequential Transducers for Generative Recommendations" (https://arxiv.org/abs/2402.17152).
semantic-router
Superfast AI decision making and intelligent processing of multi-modal data.
yet-another-applied-llm-benchmark
A benchmark to evaluate language models on questions I've previously asked them to solve.
bert_score
BERT score for text generation
intel-extension-for-transformers
⚡ Build your chatbot within minutes on your favorite device; offer SOTA compression techniques for LLMs; run LLMs efficiently on Intel Platforms⚡
text-generation-webui
A Gradio web UI for Large Language Models.
lm-evaluation-harness
A framework for few-shot evaluation of language models.
open_llama
OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset
Chinese-LLaMA-Alpaca-2
中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)
llama-recipes
Scripts for fine-tuning Meta Llama3 with composable FSDP & PEFT methods to cover single/multi-node GPUs. Supports default & custom datasets for applications such as summarization and Q&A. Supporting a number of candid inference solutions such as HF TGI, VLLM for local or cloud deployment. Demo apps to showcase Meta Llama3 for WhatsApp & Messenger.
TurboPFor-Integer-Compression
Fastest Integer Compression
streamvbyte
Fast integer compression in C using the StreamVByte codec