Fangyue Liu's starred repositories
gpt_academic
为GPT/GLM等LLM大语言模型提供实用化交互接口，特别优化论文阅读/润色/写作体验，模块化设计，支持自定义快捷按钮&函数插件，支持Python和C++等项目剖析&自译解功能，PDF/LaTex论文翻译&总结功能，支持并行问询多种LLM模型，支持chatglm3等本地模型。接入通义千问, deepseekcoder, 讯飞星火, 文心一言, llama2, rwkv, claude2, moss等。
AzurePublicDataset
Microsoft Azure Traces
DeepSpeed-MII
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
TensorRT-LLM
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.
ringattention
Transformers with Arbitrarily Large Context
Megatron-LM
Ongoing research training transformer models at scale
text-generation-inference
Large Language Model Text Generation Inference
transformers
🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
tuning_playbook
A playbook for systematically maximizing the performance of deep learning models.
awesome-chatgpt-prompts
This repo includes ChatGPT prompt curation to use ChatGPT better.
awesome-chatgpt
Curated list of awesome tools, demos, docs for ChatGPT and GPT-3
research-and-coding
研究资源列表 A curated list of research resources
academicpages.github.io
Github Pages template for academic personal websites, forked from mmistakes/minimal-mistakes
PipeSwitch
PipeSwitch: Fast Pipelined Context Switching for Deep Learning Applications