lottery-ticket-hypothesis

There are 6 repositories under lottery-ticket-hypothesis topic.

• rahulvigneswaran / Lottery-Ticket-Hypothesis-in-Pytorch

  This repository contains a Pytorch implementation of the paper "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks" by Jonathan Frankle and Michael Carbin that can be easily adapted to any model/dataset.

  deep-learningiclr2019lotterylottery-ticket-hypothesisnetwork-pruningpruningpythonpytorchpytorch-implementationwinning-ticket
  Language:Python 316

• MinghuiChen43 / awesome-deep-phenomena

  A curated list of papers of interesting empirical study and insight on deep learning. Continually updating...

  empirical-researchawesome-listdeep-learning-theorydouble-descentinformation-bottleneck-theorylottery-ticket-hypothesisneural-collapseneural-tangent-kernelneuroscience-inspired-ainon-convex-optimizationemergencegrokkingphase-transitions
  211

• VITA-Group / BERT-Tickets

  [NeurIPS 2020] "The Lottery Ticket Hypothesis for Pre-trained BERT Networks", Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Yang Zhang, Zhangyang Wang, Michael Carbin

  bertlottery-ticketslottery-ticket-hypothesispre-traininguniversal-embeddings
  Language:Python 137

• alecwangcq / GraSP

  Code for "Picking Winning Tickets Before Training by Preserving Gradient Flow" https://openreview.net/pdf?id=SkgsACVKPH

  pruningneural-networksmachine-learningdeep-learningpytorchlottery-ticket-hypothesis
  Language:Python 97

• VITA-Group / Ultra-Data-Efficient-GAN-Training

  [NeurIPS'21] "Ultra-Data-Efficient GAN Training: Drawing A Lottery Ticket First, Then Training It Toughly", Tianlong Chen, Yu Cheng, Zhe Gan, Jingjing Liu, Zhangyang Wang

  gangenerative-adversarial-networklottery-ticket-hypothesisdata-efficientaugmentationdata-efficient-gan-training
  Language:Python 84

• VITA-Group / CV_LTH_Pre-training

  [CVPR 2021] "The Lottery Tickets Hypothesis for Supervised and Self-supervised Pre-training in Computer Vision Models" Tianlong Chen, Jonathan Frankle, Shiyu Chang, Sijia Liu, Yang Zhang, Michael Carbin, Zhangyang Wang

  pre-traininglottery-ticket-hypothesistransfertransfer-learningmocosimclrsimclrv2imagenet-pr
  Language:Python 66

• VITA-Group / Unified-LTH-GNN

  [ICML 2021] "A Unified Lottery Tickets Hypothesis for Graph Neural Networks", Tianlong Chen*, Yongduo Sui*, Xuxi Chen, Aston Zhang, Zhangyang Wang

  lottery-ticket-hypothesisgraph-neural-networksco-designco-optimizationgraph-sparsificationpruning
  Language:Python 59

• varungohil / Generalizing-Lottery-Tickets

  This repository contains code to replicate the experiments given in NeurIPS 2019 paper "One ticket to win them all: generalizing lottery ticket initializations across datasets and optimizers"

  lottery-ticket-hypothesisgeneralizationpruningneurips-2019reproducibility-challengeneural-network-compression
  Language:Jupyter Notebook 50

• VITA-Group / Sparsity-Win-Robust-Generalization

  [ICLR 2022] "Sparsity Winning Twice: Better Robust Generalization from More Efficient Training" by Tianlong Chen*, Zhenyu Zhang*, Pengjun Wang*, Santosh Balachandra*, Haoyu Ma*, Zehao Wang, Zhangyang Wang

  sparsityrobust-generalizationrobust-overfittingpruningdynamic-sparse-traininggeneralizationlottery-ticket-hypothesis
  Language:Python 36

• arjun-majumdar / Lottery_Ticket_Hypothesis-TensorFlow_2

  Implementing "The Lottery Ticket Hypothesis" paper by "Jonathan Frankle, Michael Carbin"

  lottery-ticket-hypothesispaperwinning-ticketstensorflow2python3
  Language:Jupyter Notebook 33

• VITA-Group / Audio-Lottery

  [ICLR 2022] "Audio Lottery: Speech Recognition Made Ultra-Lightweight, Noise-Robust, and Transferable", by Shaojin Ding, Tianlong Chen, Zhangyang Wang

  pytorchneural-network-compressionlottery-ticket-hypothesisspeech-recognitionctcconformer
  Language:Python 30

• gfrogat / prunhild

  A small library implementing magnitude-based pruning in PyTorch

  lottery-ticket-hypothesispruningpytorch
  Language:Python 28

• VITA-Group / Structure-LTH

  [ICML 2022] "Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets" by Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wang, Zhangyang Wang.

  lottery-ticket-hypothesisstructural-winning-ticketsstructural-sparsitychannel-wise-sparsitygroup-wise-sparsity
  Language:Cuda 28

• VITA-Group / GAN-LTH

  [ICLR 2021] "GANs Can Play Lottery Too" by Xuxi Chen, Zhenyu Zhang, Yongduo Sui, Tianlong Chen

  gangenerative-adversarial-networklottery-ticket-hypothesistransferpruning
  Language:Python 27

• VITA-Group / Backdoor-LTH

  [CVPR 2022] "Quarantine: Sparsity Can Uncover the Trojan Attack Trigger for Free" by Tianlong Chen*, Zhenyu Zhang*, Yihua Zhang*, Shiyu Chang, Sijia Liu, and Zhangyang Wang

  trojanbackdoor-attackssparsitylottery-ticket-hypothesislinear-mode-connectivityreverse-engineering
  Language:Python 24

• VITA-Group / Lifelong-Learning-LTH

  [ICLR 2021] "Long Live the Lottery: The Existence of Winning Tickets in Lifelong Learning" by Tianlong Chen*, Zhenyu Zhang*, Sijia Liu, Shiyu Chang, Zhangyang Wang

  lifelong-learninglottery-ticket-hypothesislthwinning-ticketscontinue-learning
  Language:Python 22

• GATECH-EIC / SuperTickets

  [ECCV 2022] SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning

  lottery-ticket-hypothesisneural-architecture-search
  Language:Python 17

• cliang1453 / super-structured-lottery-tickets

  Super Tickets in Pre-Trained Language Models: From Model Compression to Improving Generalization (ACL 2021)

  acl2021bert-fine-tuninggeneralizationlottery-ticket-hypothesislottery-ticketsmodel-compressionmodel-pruningmulti-task-learningnatural-language-understandingpre-trained-language-models
  Language:Python 16

• llyx97 / TAMT

  [NAACL 2022] "Learning to Win Lottery Tickets in BERT Transfer via Task-agnostic Mask Training", Yuanxin Liu, Fandong Meng, Zheng Lin, Peng Fu, Yanan Cao, Weipinng Wang, Jie Zhou

  bertlottery-ticket-hypothesispytorch-implementationtranfer-learning
  Language:Python 15

• GATECH-EIC / Robust-Scratch-Ticket

  [NeurIPS 2021] "Drawing Robust Scratch Tickets: Subnetworks with Inborn Robustness Are Found within Randomly Initialized Networks" by Yonggan Fu, Qixuan Yu, Yang Zhang, Shang Wu, Xu Ouyang, David Cox, Yingyan Lin

  lottery-ticket-hypothesismodel-robustness
  Language:Python 13
• ordinary-neural-circuits

  raminmh / ordinary-neural-circuits

  Code repo for paper: ICML 2020 paper Natural lottery ticket winner: RL for ordinary neural circuits

  deep-learningdeep-reinforcement-learninglottery-ticket-hypothesisneural-circuitsneural-networkspythonreinforcement-learningroboticstensorflow
  Language:Python 12

• VITA-Group / LTH-Pass

  [TMLR] "Can You Win Everything with Lottery Ticket?" by Tianlong Chen, Zhenyu Zhang, Jun Wu, Randy Huang, Sijia Liu, Shiyu Chang, Zhangyang Wang

  lottery-ticket-hypothesisgeneralizationout-of-distribution-detectionadversarial-robustnessrobustnessuncertaintyflatnessloss-landscapepac-bayesexplanabilityinterpretabilitywinning-tickets
  Language:Python 10

• mahkons / Lottery-ticket-hypothesis

  This repository contains a Pytorch implementation of the article "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks" and an application of this hypothesis to reinforcement learning

  lottery-ticket-hypothesisreinforcement-learningpytorchdqnatarinetwork-pruning
  Language:Python 9

• mcognetta / LotteryTickets.jl

  Sparsify Your Flux Models

  fluxjuliajulia-languagelottery-ticket-hypothesismachine-learningmodel-compressionsparsification
  Language:Julia 9

• VITA-Group / Double-Win-LTH

  [ICML 2022] "Data-Efficient Double-Win Lottery Tickets from Robust Pre-training" by Tianlong Chen, Zhenyu Zhang, Sijia Liu, Yang Zhang, Shiyu Chang, Zhangyang Wang

  adversarial-robustnessdata-efficientgeneralizationlottery-ticket-hypothesispretrainingsparsitytransfer-learningrobust-pretraining
  Language:Python 9

• negar-foroutan / multiLMs-lang-neutral-subnets

  [EMNLP 2022] Discovering Language-neutral Sub-networks in Multilingual Language Models.

  lottery-ticket-hypothesismultilingual-language-modelsmultilingual-nlpmbertmt5cross-lingual-transfer
  Language:Python 8

• VITA-Group / NO-stealing-LTH

  [NeurIPS'21] "You are caught stealing my winning lottery ticket! Making a lottery ticket claim its ownership" by Xuxi Chen*, Tianlong Chen*, Zhenyu Zhang, Zhangyang Wang

  intellectual-propertylottery-ticket-hypothesisqrcodewatermarkwinning-tickets
  Language:Python 8

• landskape-ai / Reprogram_LT

  [arXiv] "Uncovering the Hidden Cost of Model Compression" by Diganta Misra, Agam Goyal, Bharat Runwal, and Pin-Yu Chen

  adversarial-reprogramingcalibrationlinear-probinglottery-ticket-hypothesislottery-ticketssparsitytransfer-learningvisual-promptingpruning
  Language:Python 7

• shantanu-ai / Explainability-with-LTH

  Repository of the course project of CMU 16-824 Visual Learning and Recognition

  computer-visionexplainable-aigrad-cam-visualizationlottery-ticket-hypothesispruningtcavcnndeep-learningpytorchvlr16-824cub200-2011
  Language:Jupyter Notebook 5

• CISiPLab / cisip-CoCa

  Compact Image Captioning (CoCA) is an open source image captioning project to promote Green Computer Vision, as well as to make image captioning research accessible to universities, research labs and individual practitioners with limited financial resources.

  deep-compressiongreen-computingimage-captioningms-cococomputer-visionnatural-language-processinglottery-ticket-hypothesispruningsparsity-optimization
  Language:Python 3

• KittenCN / predict_Lottery_ticket_fork_edit

  基于tensorflow lstm模型的彩票预测

  lotterylottery-ticket-hypothesislstmpredict
  Language:Python 3

• Krishnkant-Swarnkar / Pytorch-pruning

  Implementation of various neural network pruing methods in pytorch.

  pruningpytorchneural-network-compressionmnistcifar-10resnetlenetlottery-ticket-hypothesis
  Language:Jupyter Notebook 3

• xzwj / optimization_objective_of_lottery_ticket_hypothesis

  deep-learninglottery-ticket-hypothesispytorch
  Language:Python 3

• KT19 / pytorch

  pytorch implementation

  singanpruningfader-networksarcfacelottery-ticket-hypothesis
  Language:Jupyter Notebook 2

• lecode-official / pytorch-lottery-ticket-hypothesis

  A PyTorch implementation of the Lottery Ticket algorithm introduced by Frankle et al. in "The Lottery Ticket Hypothesis: Finding Sparse, Trainable Neural Networks" and enhanced by Zhou et al. in "Deconstructing Lottery Tickets: Zeros, Signs, and the Supermask".

  deep-learninglottery-ticket-hypothesispruningpythonpytorchpytorch-implementation
  Language:Python 2

• PatzEdi / PowerballProbabilities

  Powerball Lottery Data Probability loader and Parser written in Python

  datadatasetlotterylottery-ticket-hypothesismachine-learning
  Language:Python 2