Li Dong's starred repositories
generative-models
Generative Models by Stability AI
text-generation-inference
Large Language Model Text Generation Inference
chatgpt_system_prompt
A collection of GPT system prompts and various prompt injection/leaking knowledge.
promptbase
All things prompt engineering
alignment-handbook
Robust recipes to align language models with human and AI preferences
consistencydecoder
Consistency Distilled Diff VAE
TransformerEngine
A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilization in both training and inference.
GPT-4V-Act
AI agent using GPT-4V(ision) capable of using a mouse/keyboard to interact with web UI
faiss_tips
Some useful tips for faiss
datablations
Scaling Data-Constrained Language Models
lost-in-the-middle
Code and data for "Lost in the Middle: How Language Models Use Long Contexts"
flash-fft-conv
FlashFFTConv: Efficient Convolutions for Long Sequences with Tensor Cores
InfiniteBench
100k+ Long-Context Benchmark for Large Language Models (paper upcoming)
causal-conv1d
Causal depthwise conv1d in CUDA, with a PyTorch interface