munian-ustc / Awesome-NAS

A curated list of neural architecture search (NAS) resources.

Awesome NAS

A curated list of neural architecture search and related resources. Inspired by awesome-deep-vision, awesome-adversarial-machine-learning, awesome-deep-learning-papers, and awesome-architecture-search.

Please feel free to pull requests or open an issue to add papers.

Table of Contents

• Awesome Blogs

• Neural Architecture Search

  • 2020 Venues
  • 2019 Venues
  • 2018 Venues
  • 2017 Venues
  • Previous Venues
  • arXiv

Awesome Blogs

• AutoML info and AutoML Freiburg-Hannover
• What’s the deal with Neural Architecture Search?
• Google Could AutoML and PocketFlow
• AutoML Challenge and AutoDL Challenge

Neural Architecture Search (NAS)

Type	G	RL	EA	PD	Other
Explanation	gradient-based	reinforcement learning	evaluationary algorithm	performance prediction	other types

2020

In submission, XDDD.

2019

Title	Venue	Type	Code
Progressive Differentiable Architecture Search: Bridging the Depth Gap Between Search and Evaluation	ICCV
Multinomial Distribution Learning for Effective Neural Architecture Search	ICCV
Searching for MobileNetV3	ICCV	EA	-
Fast and Practical Neural Architecture Search	ICCV
Teacher Guided Architecture Search	ICCV		-
AutoDispNet: Improving Disparity Estimation With AutoML	ICCV	G	-
Resource Constrained Neural Network Architecture Search: Will a Submodularity Assumption Help?	ICCV	EA	-
Towards modular and programmable architecture search	NeurIPS	Other	Github
Network Pruning via Transformable Architecture Search	NeurIPS	G	Github
Deep Active Learning with a NeuralArchitecture Search	NeurIPS	-	-
DetNAS: Backbone Search for ObjectDetection	NeurIPS	-	-
SpArSe: Sparse Architecture Search for CNNs on Resource-Constrained Microcontrollers	NeurIPS	-	-
Efficient Forward Architecture Search	NeurIPS	G	Github
Efficient Neural ArchitectureTransformation Search in Channel-Level for Object Detection	NeurIPS	G	-
XNAS: Neural Architecture Search with Expert Advice	NeurIPS	G	-
One-Shot Neural Architecture Search via Self-Evaluated Template Network	ICCV	G	Github
Evolving Space-Time Neural Architectures for Videos	ICCV	EA	GitHub
AutoGAN: Neural Architecture Search for Generative Adversarial Networks	ICCV	RL	github
Neural architecture search: A survey	JMLR	Survey	-
DARTS: Differentiable Architecture Search	ICLR	G	github
ProxylessNAS: Direct Neural Architecture Search on Target Task and Hardware	ICLR	RL/G	github
Graph HyperNetworks for Neural Architecture Search	ICLR	G	-
Learnable Embedding Space for Efficient Neural Architecture Compression	ICLR	Other	github
Efficient Multi-Objective Neural Architecture Search via Lamarckian Evolution	ICLR	EA	-
SNAS: stochastic neural architecture search	ICLR	G	-
Searching for A Robust Neural Architecture in Four GPU Hours	CVPR	G	Github
ChamNet: Towards Efficient Network Design through Platform-Aware Model Adaptation	CVPR	-	-
Partial Order Pruning: for Best Speed/Accuracy Trade-off in Neural Architecture Search	CVPR	EA	github
FBNet: Hardware-Aware Efficient ConvNet Design via Differentiable Neural Architecture Search	CVPR	G	-
RENAS: Reinforced Evolutionary Neural Architecture Search	CVPR	G	-
Auto-DeepLab: Hierarchical Neural Architecture Search for Semantic Image Segmentation	CVPR	G	GitHub
MnasNet: Platform-Aware Neural Architecture Search for Mobile	CVPR	RL	Github
MFAS: Multimodal Fusion Architecture Search	CVPR	EA	-
A Neurobiological Evaluation Metric for Neural Network Model Search	CVPR	Other	-
Fast Neural Architecture Search of Compact Semantic Segmentation Models via Auxiliary Cells	CVPR	RL	-
Customizable Architecture Search for Semantic Segmentation	CVPR	-	-
Regularized Evolution for Image Classifier Architecture Search	AAAI	EA	-
AutoAugment: Learning Augmentation Policies from Data	CVPR	RL	-
Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules	ICML	EA	-
The Evolved Transformer	ICML	EA	Github
EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks	ICML	RL	-
NAS-Bench-101: Towards Reproducible Neural Architecture Search	ICML	Other	Github

2018

Title	Venue	Type	Code
Towards Automatically-Tuned Deep Neural Networks	BOOK	-	GitHub
Efficient Architecture Search by Network Transformation	AAAI	RL	github
Learning Transferable Architectures for Scalable Image Recognition	CVPR	RL	github
N2N learning: Network to Network Compression via Policy Gradient Reinforcement Learning	ICLR	RL	-
A Flexible Approach to Automated RNN Architecture Generation	ICLR	RL/PD	-
Practical Block-wise Neural Network Architecture Generation	CVPR	RL	-
Path-Level Network Transformation for Efficient Architecture Search	ICML	RL	github
Hierarchical Representations for Efficient Architecture Search	ICLR	EA	-
Understanding and Simplifying One-Shot Architecture Search	ICML	G	-
SMASH: One-Shot Model Architecture Search through HyperNetworks	ICLR	G	github
Neural Architecture Optimization	NeurIPS	G	github
Searching for efficient multi-scale architectures for dense image prediction	NeurIPS	Other	-
Progressive Neural Architecture Search	ECCV	PD	github
Neural Architecture Search with Bayesian Optimisation and Optimal Transport	NeurIPS	Other	github
Differentiable Neural Network Architecture Search	ICLR-W	G	-
Accelerating Neural Architecture Search using Performance Prediction	ICLR-W	PD	-

2017

Title	Venue	Type	Code
Neural Architecture Search with Reinforcement Learning	ICLR	RL	-
Designing Neural Network Architectures using Reinforcement Learning	ICLR	RL	-
Neural Optimizer Search with Reinforcement Learning	ICML	RL	-
Learning Curve Prediction with Bayesian Neural Networks	ICLR	PD	-
Hyperband: A Novel Bandit-Based Approach to Hyperparameter Optimization	ICLR	PD	-
Hyperparameter Optimization: A Spectral Approach	NeurIPS-W	Other	github
Learning to Compose Domain-Specific Transformations for Data Augmentation	NeurIPS	-	-

2012-2016

Title	Venue	Type	Code
Speeding up Automatic Hyperparameter Optimization of Deep Neural Networksby Extrapolation of Learning Curves	IJCAI	PD	github

arXiv

Title	Date	Type	Code
PC-DARTS: Partial Channel Connections for Memory-Efficient Differentiable Architecture Search	2019.07	G	github
Population Based Training of Neural Networks	2017.11	EA	-
NSGA-NET: A Multi-Objective Genetic Algorithm for Neural Architecture Search	2018.10	EA	-
Random Search and Reproducibility for Neural Architecture Search	2019.01	G	-
Training Frankenstein’s Creature to Stack: HyperTree Architecture Search	2018.10	G	-
Fast, Accurate and Lightweight Super-Resolution with Neural Architecture Search	2019.01	G	github