liupeng's repositories
bitsandbytes
8-bit CUDA functions for PyTorch
ChineseNLPCorpus
中文自然语言处理数据集，平时做做实验的材料。欢迎补充提交合并。
FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
flash-attention
Fast and memory-efficient exact attention
Fuser
A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
GPTs
leaked prompts of GPTs
LLMTest_NeedleInAHaystack
Doing simple retrieval from LLM models at various context lengths to measure accuracy
lm-evaluation-harness
A framework for few-shot evaluation of autoregressive language models.
marker
Convert PDF to markdown quickly with high accuracy
Megatron-LM
Ongoing research training transformer models at scale
nougat
Implementation of Nougat Neural Optical Understanding for Academic Documents
open-interpreter
A natural language interface for computers
optimum
🚀 Accelerate training and inference of 🤗 Transformers and 🤗 Diffusers with easy to use hardware optimization tools
privateGPT
Interact with your documents using the power of GPT, 100% privately, no data leaks
QAnything
Question and Answer based on Anything.
sensitive-word
👮♂️The sensitive word tool for java.(敏感词/违禁词/违法词/脏词。基于 DFA 算法实现的高性能 java 敏感词过滤工具框架。请勿发布涉及政治、广告、营销、翻墙、违反国家法律法规等内容。高性能敏感词检测过滤组件，附带繁体简体互换，支持全角半角互换，汉字转拼音，模糊搜索等功能。)
stable-diffusion-webui
Stable Diffusion web UI
stopwords
中文常用停用词表（哈工大停用词表、百度停用词表等）
text-generation-webui
A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.
ThunderKittens
Tile primitives for speedy kernels
TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
triton
Development repository for the Triton language and compiler
vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
wikitextprocessor
Python package for WikiMedia dump processing (Wiktionary, Wikipedia etc). Wikitext parsing, template expansion, Lua module execution. For data extraction, bulk syntax checking, error detection, and offline formatting.