bhheo

transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

nanoGPT

The simplest, fastest repository for training/finetuning medium-sized GPTs.

fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

detectron2

Detectron2 is a platform for object detection, segmentation and other visual recognition tasks.

unilm

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

open_clip

An open source implementation of CLIP.

detrex

detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks.

Swin-Transformer-Semantic-Segmentation

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows" on Semantic Segmentation.

Compact-Transformers

Escaping the Big Data Paradigm with Compact Transformers, 2021 (Train your Vision Transformers in 30 mins on CIFAR-10 with a single GPU!)

awesome-source-free-test-time-adaptation

A curated list of papers in Test-time Adaptation, Test-time Training and Source-free Domain Adaptation

korean-safety-benchmarks

Official datasets and pytorch implementation repository of SQuARe and KoSBi (ACL 2023)

simple-hierarchical-transformer

Experiments around a simple idea for inducing multiple hierarchical predictive model within a GPT

FT-CLIP

CLIP Itself is a Strong Fine-tuner: Achieving 85.7% and 88.0% Top-1 Accuracy with ViT-B and ViT-L on ImageNet

pytorch-revgrad

A minimal pytorch package implementing a gradient reversal layer.

mae_segmentation

reproduction of semantic segmentation using masked autoencoder (mae)

DMAE

[CVPR 2023] This repository includes the official implementation our paper "Masked Autoencoders Enable Efficient Knowledge Distillers"

GradAug

[NeurIPS'20] GradAug: A New Regularization Method for Deep Neural Networks

data2vec_vision

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

rope-vit

model-stock

rdnet

LoMaR

LoMaR (Efficient Self-supervised Vision Pretraining with Local Masked Reconstruction)

dbot

[ICLR2024] Exploring Target Representations for Masked Autoencoders

seit

pcmepp

Official Pytorch implementation of "Improved Probabilistic Image-Text Representations" (ICLR 2024)

augsub

Masking Augmentation for Supervised Learning (arxiv)

imagenet-12k

ImageNet-12k subset of ImageNet-21k (fall11)

kcenter_video

tokenadapt