Jianquan Ye's starred repositories
vit_10b_fsdp_example
See details in https://github.com/pytorch/xla/blob/r1.12/torch_xla/distributed/fsdp/README.md
Probabilistic-Programming-and-Bayesian-Methods-for-Hackers
aka "Bayesian Methods for Hackers": An introduction to Bayesian methods + probabilistic programming with a computation/understanding-first, mathematics-second point of view. All in pure Python ;)
Awesome-Chinese-NLP
A curated list of resources for Chinese NLP 中文自然语言处理相关资料
transformers_tasks
⭐️ NLP Algorithms with transformers lib. Supporting Text-Classification, Text-Generation, Information-Extraction, Text-Matching, RLHF, SFT etc.
SwissArmyTransformer
SwissArmyTransformer is a flexible and powerful library to develop your own Transformer variants.
InstructGLM
ChatGLM-6B 指令学习|指令数据|Instruct
bitsandbytes
Accessible large language models via k-bit quantization for PyTorch.
Transformer_Knowlegde
从底层机理了解Transformer
face_recognition
The world's simplest facial recognition api for Python and the command line
MobileVit_TensorRT
TensorRT 2022 亚军方案,tensorrt加速mobilevit模型
awesome-ml-model-compression
Awesome machine learning model compression research papers, tools, and learning material.
TableGeneration
通过浏览器渲染生成表格图像
CKA-Centered-Kernel-Alignment
Reproduce CKA: Similarity of Neural Network Representations Revisited
EfficientFormer
EfficientFormerV2 [ICCV 2023] & EfficientFormer [NeurIPs 2022]
mdistiller
The official implementation of [CVPR2022] Decoupled Knowledge Distillation https://arxiv.org/abs/2203.08679 and [ICCV2023] DOT: A Distillation-Oriented Trainer https://openaccess.thecvf.com/content/ICCV2023/papers/Zhao_DOT_A_Distillation-Oriented_Trainer_ICCV_2023_paper.pdf
rethinking-network-pruning
Rethinking the Value of Network Pruning (Pytorch) (ICLR 2019)
TensorRT-Inference-Server-Tutorial
服务侧深度学习部署案例
RepDistiller
[ICLR 2020] Contrastive Representation Distillation (CRD), and benchmark of recent knowledge distillation methods
insightface
State-of-the-art 2D and 3D Face Analysis Project