wkcn

TinyCLIP

[ICCV2023] TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance

TinyViT

[ECCV 2022] TinyViT: Fast Pretraining Distillation for Small Vision Transformers (https://github.com/microsoft/Cream/tree/main/TinyViT)

pyjackal

赤色要塞Python复刻版

iRPE-model-zoo

The Model Zoo of the ICCV 2021 paper `Rethinking and Improving Relative Position Encoding for Vision Transformer`

TinyViT-model-zoo

The model zoo of TinyViT: Fast Pretraining Distillation for Small Vision Transformers

MyVimConfig

我的Vim配置文件

HappyQQT-ASM

An Intel 8086 Emulator for QQTang-ASM

leetcode

nccl

TinyCLIP-model-zoo

The model zoo of TinyCLIP: CLIP Distillation via Affinity Mimicking and Weight Inheritance

iRPE

[ICCV 2021] Rethinking and Improving Relative Position Encoding for Vision Transformer (https://github.com/microsoft/Cream/tree/main/iRPE)

Poly

基于SLang的多项式运算系统

SLang

SLang解释器和高精度实现，向Lisp致敬

Cream

This is a collection of our NAS and Vision Transformer work.

DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

EmulateBinary

EmulateBinary - written in Oct 30, 2015

evaluating_machine_accuracy_on_imagenet

LeViT-1

LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference

LLM-Training-Puzzles

What would you do with 1000 H100s...

Megatron-LM

Ongoing research training transformer models at scale

metaseq

Repo for external large-scale work

MS-AMP

Microsoft Automatic Mixed Precision Library

MS-AMP-Examples

Examples for MS-AMP package.

open_clip-fork

An open source implementation of CLIP.

QPyTorch

Low Precision Arithmetic Simulation in PyTorch

SicilyToy

西西里酱的玩具，请把玩具交给西西里 >_<

test_norm

Test BatchNorm, LayerNorm and Instance Norm

TracKit

[ECCV'20] Ocean: Object-aware Anchor-Free Tracking

TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper GPUs, to provide better performance with lower memory utilization in both training and inference.

translators

🌏🌍🌎Translators🌎🌍🌏 is a library which aims to bring free, multiple, enjoyable translation to individuals and students in Python. Translators是一个旨在用Python为个人和学生带来免费、多样、愉快翻译的库。