wonderisland's starred repositories
long-context-attention
Sequence Parallel Attention for Long Context LLM Model Training and Inference
Pai-Megatron-Patch
The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
Moore-AnimateAnyone
Character Animation (AnimateAnyone, Face Reenactment)
accelerate
🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support
digital_video_introduction
A hands-on introduction to video technology: image, video, codec (av1, vp9, h265) and more (ffmpeg encoding). Translations: 🇺🇸 🇨🇳 🇯🇵 🇮🇹 🇰🇷 🇷🇺 🇧🇷 🇪🇸
ChatGLM-6B
ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型
best_AI_papers_2022
A curated list of the latest breakthroughs in AI (in 2022) by release date with a clear video explanation, link to a more in-depth article, and code.
alpaca-lora
Instruct-tune LLaMA on consumer hardware
PyTorchIntroduction
《深入浅出 PyTorch——从模型到源码》源代码和勘误(见Issues)
Prompt-Engineering-Guide
🐙 Guides, papers, lecture, notebooks and resources for prompt engineering
stanford_alpaca
Code and documentation to train Stanford's Alpaca models, and generate the data.
Awesome-Books-Notes
:books: Awesome CS Books(with Digests)/Series(.pdf by git lfs) Warehouse for Geeks, ProgrammingLanguage, SoftwareEngineering, Web, AI, ServerSideApplication, Infrastructure, FE etc. :dizzy: 优秀计算机科学与技术领域相关的书籍归档,以及我的读书笔记。
AI-Infer-Engine-From-Zero
关于自建AI推理引擎的手册,从0开始你需要知道的所有事情
papers-notebook
:page_facing_up: :cn: :page_with_curl: 论文阅读笔记(分布式系统、虚拟化、机器学习)Papers Notebook (Distributed System, Virtualization, Machine Learning)
auto_http_api
python自动化接口测试
External-Attention-pytorch
🍀 Pytorch implementation of various Attention Mechanisms, MLP, Re-parameter, Convolution, which is helpful to further understand papers.⭐⭐⭐