Deep Learning Papers by task
Papers about deep learning ordered by task, date. Current state-of-the-art papers and papers useful for getting started are labelled. For each paper there is a permanent link, which is either to Arxiv.org or to a copy of the original paper in this repository.
Table of Contents
-
1.1. Code Generation
1.2. Malware Detection
-
2.1. Summarization
2.2. Classification
2.3. Question Answering
2.4. Sentiment Analysis
2.5. Translation
2.6. Chatbots
-
3.1. Gaming
3.2. Style Transfer
3.3. Object Tracking
3.4. Visual Question Answering
3.5. Image Segmentation
3.6. Text (in the Wild) Recognition
3.7. Brain Computer Interfacing
3.8. Self-Driving Cars
3.9. Object Recognition
3.10. Logo Recognition
3.11. Super Resolution
3.12. Pose Estimation
3.13. Image Captioning
3.14. Image Compression
3.15. Image Synthesis
3.16. Face Recognition
-
4.1. Audio Synthesis
-
5.1. Unclassified
5.2. Regularization
5.3. Neural Network Compression
5.4. Optimizers
Code
Code Generation
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
DeepAM: Migrate APIs with Multi-modal Sequence to Sequence Learning | 25 apr 2017 | arxiv | None | |
A Syntactic Neural Model for General-Purpose Code Generation | 6 apr 2017 | arxiv | None | |
RobustFill: Neural Program Learning under Noisy I/O | 21 mar 2017 | arxiv | None | |
DeepFix: Fixing Common C Language Errors by Deep Learning | 12 feb 2017 | paper | None | |
DeepCoder: Learning to Write Programs | 7 nov 2016 | arxiv | None | |
Neuro-Symbolic Program Synthesis | 6 nov 2016 | arxiv | None | |
Deep API Learning | 27 may 2016 | arxiv | None |
Malware Detection
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Deep Android Malware Detection | 22 mar 2016 | paper | github | None |
Droid-Sec: Deep Learning in Android Malware Detection | 17 aug 2014 | paper | github | None |
Text
Summarization
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
A Deep Reinforced Model for Abstractive Summarization | 11 may 2017 | arxiv | None | |
Get To The Point: Summarization with Pointer-Generator Networks | 14 apr 2017 | arxiv | None | |
SummaRuNNer: A Recurrent Neural Network based Sequence Model for Extractive Summarization of Documents | 14 nov 2016 | arxiv | None |
Classification
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
A Large Self-Annotated Corpus for Sarcasm | 19 apr 2017 | arxiv | None | |
ConceptNet at SemEval-2017 Task 2: Extending Word Embeddings with Multilingual Relational Knowledge | 11 apr 2017 | arxiv | None | |
Bilateral Multi-Perspective Matching for Natural Language Sentences | 13 feb 2017 | arxiv | None | |
FastText.zip: Compressing text classification models | 12 dec 2016 | arxiv | None | |
ConceptNet 5.5: An Open Multilingual Graph of General Knowledge | 12 dec 2016 | arxiv | None | |
A Simple but Tough-to-Beat Baseline for Sentence Embeddings | 4 nov 2016 | paper | github | None |
Enriching Word Vectors with Subword Information | 15 jul 2016 | arxiv | None | |
From Word Embeddings To Document Distances | 6 jul 2016 | paper | github | None |
Bag of Tricks for Efficient Text Classification | 6 jul 2016 | arxiv | None | |
Character-level Convolutional Networks for Text Classification | 4 sep 2015 | arxiv | None | |
GloVe: Global Vectors for Word Representation | 25 may 2015 | paper | github | None |
Improved Semantic Representations From Tree-Structured Long Short-Term Memory Networks | 28 feb 2015 | arxiv | None | |
Distributed Representations of Sentences and Documents | 16 may 2014 | arxiv | None | |
Efficient Estimation of Word Representations in Vector Space | 16 jan 2013 | arxiv | None | |
SimHash: Hash-based Similarity Detection | 13 dec 2007 | paper | None |
Question Answering
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models | 30 may 2017 | arxiv | github |
Sentiment Analysis
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Rationalizing Neural Predictions | 13 jun 2016 | arxiv | None | |
Recursive Deep Models for Semantic Compositionality Over a Sentiment Treebank | 18 okt 2013 | paper | None |
Translation
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Attention Is All You Need | 12 jun 2017 | arxiv | ||
Convolutional Sequence to Sequence Learning | 8 may 2017 | arxiv | github | |
Google's Multilingual Neural Machine Translation System: Enabling Zero-Shot Translation | 14 nov 2016 | arxiv | None | |
A Convolutional Encoder Model for Neural Machine Translation | 7 nov 2016 | arxiv | None | |
Google's Neural Machine Translation System: Bridging the Gap between Human and Machine Translation | 26 sep 2016 | arxiv | None | |
Neural Machine Translation by Jointly Learning to Align and Translate | 1 sep 2014 | arxiv | None |
Chatbots
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
A Deep Reinforcement Learning Chatbot | 7 sep 2017 | arxiv | None |
Visual
Gaming
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Phase-Functioned Neural Networks for Character Control | 1 may 2017 | paper | None | |
Equivalence Between Policy Gradients and Soft Q-Learning | 21 apr 2017 | arxiv | ||
Beating Atari with Natural Language Guided Reinforcement Learning | 18 apr 2017 | arxiv | ||
Learning from Demonstrations for Real World Reinforcement Learning | 12 apr 2017 | arxiv | ||
FeUdal Networks for Hierarchical Reinforcement Learning | 3 mar 2017 | arxiv | ||
Overcoming catastrophic forgetting in neural networks | 2 dec 2016 | arxiv | ||
Playing Doom with SLAM-Augmented Deep Reinforcement Learning | 1 dec 2016 | arxiv | None | |
Playing FPS Games with Deep Reinforcement Learning | 18 sep 2016 | arxiv | None | |
DeepChess: End-to-End Deep Neural Network for Automatic Learning in Chess | 16 aug 2016 | paper | None | |
Generative Adversarial Imitation Learning | 10 jun 2016 | arxiv | None | |
Dueling Network Architectures for Deep Reinforcement Learning | 20 nov 2015 | arxiv | ||
Prioritized Experience Replay | 18 nov 2015 | arxiv | None | |
Human-level control through deep reinforcement learning | 26 feb 2015 | paper | ||
Playing Atari with Deep Reinforcement Learning | 19 dec 2013 | arxiv |
Style Transfer
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Deep Photo Style Transfer | 22 mar 2017 | arxiv | None | |
Arbitrary Style Transfer in Real-time with Adaptive Instance Normalization | 20 mar 2017 | arxiv | github | None |
A Learned Representation For Artistic Style | 24 okt 2016 | arxiv | None | |
Instance Normalization: The Missing Ingredient for Fast Stylization | 27 jul 2016 | arxiv | None | |
Perceptual Losses for Real-Time Style Transfer and Super-Resolution | 27 mar 2016 | arxiv | github | None |
A Neural Algorithm of Artistic Style | 26 aug 2015 | arxiv | github | None |
Object Tracking
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
End-to-end representation learning for Correlation Filter based tracking | 20 apr 2017 | arxiv | github | None |
Visual Question Answering
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
VQA: Visual Question Answering | 3 may 2015 | arxiv | None |
Image Segmentation
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Dilated Residual Networks | 22 jul 2017 | paper | None | |
SfM-Net: Learning of Structure and Motion from Video | 25 apr 2017 | arxiv | None | |
Mask R-CNN | 20 mar 2017 | arxiv | ||
Learning Features by Watching Objects Move | 19 dec 2016 | arxiv | ||
RefineNet: Multi-Path Refinement Networks for High-Resolution Semantic Segmentation | 20 nov 2016 | arxiv | github | None |
UberNet: Training a `Universal' Convolutional Neural Network for Low-, Mid-, and High-Level Vision using Diverse Datasets and Limited Memory | 7 sep 2016 | arxiv | None | |
DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs | 2 jun 2016 | arxiv | None | |
Fully Convolutional Networks for Semantic Segmentation | 20 may 2016 | arxiv | github | None |
Instance-aware Semantic Segmentation via Multi-task Network Cascades | 14 dec 2015 | arxiv | None | |
Multi-Scale Context Aggregation by Dilated Convolutions | 23 nov 2015 | arxiv | None | |
SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation | 2 nov 2015 | arxiv | None | |
U-Net: Convolutional Networks for Biomedical Image Segmentation | 18 may 2015 | arxiv | None | |
Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs | 22 dec 2014 | arxiv | None | |
Learning Rich Features from RGB-D Images for Object Detection and Segmentation | 22 jul 2014 | arxiv | None |
Text (in the Wild) Recognition
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
OCR Error Correction Using Character Correction and Feature-Based Word Classification | 21 apr 2016 | arxiv | None | |
Recursive Recurrent Nets with Attention Modeling for OCR in the Wild | 9 mar 2016 | arxiv | None | |
COCO-Text: Dataset and Benchmark for Text Detection and Recognition in Natural Images | 26 jan 2016 | arxiv | None | |
Efficient Scene Text Localization and Recognition with Local Character Refinement | 14 apr 2015 | arxiv | None | |
Reading Text in the Wild with Convolutional Neural Networks | 4 dec 2014 | arxiv | None | |
Synthetic Data and Artificial Neural Networks for Natural Scene Text Recognition | 9 jun 2014 | arxiv | None |
Brain Computer Interfacing
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Deep learning with convolutional neural networks for brain mapping and decoding of movement-related information from the human EEG | 15 mar 2017 | arxiv | None | |
Encoding Voxels with Deep Learning | 2 dec 2015 | paper | None | |
Deep Neural Networks Reveal a Gradient in the Complexity of Neural Representations across the Ventral Stream | 8 jul 2015 | paper | None |
Self-Driving Cars
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art | 18 apr 2017 | arxiv | None | |
End to End Learning for Self-Driving Cars | 25 apr 2016 | arxiv | None |
Object Recognition
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Focal Loss for Dense Object Detection | 7 aug 2017 | arxiv | None | |
Introspective Classifier Learning: Empower Generatively | 25 apr 2017 | arxiv | None | |
Learning Chained Deep Features and Classifiers for Cascade in Object Detection | 23 feb 2017 | arxiv | None | |
DSSD : Deconvolutional Single Shot Detector | 23 jan 2017 | arxiv | ||
YOLO9000: Better, Faster, Stronger | 25 dec 2016 | arxiv | github | |
Feature Pyramid Networks for Object Detection | 9 dec 2016 | arxiv | ||
Speed/accuracy trade-offs for modern convolutional object detectors | 30 nov 2016 | arxiv | None | |
Aggregated Residual Transformations for Deep Neural Networks | 16 nov 2016 | arxiv | None | |
Aggregated Residual Transformations for Deep Neural Networks | 16 nov 2016 | arxiv | None | |
Hierarchical Object Detection with Deep Reinforcement Learning | 11 nov 2016 | arxiv | ||
Xception: Deep Learning with Depthwise Separable Convolutions | 7 okt 2016 | arxiv | None | |
Learning to Make Better Mistakes: Semantics-aware Visual Food Recognition | 1 okt 2016 | paper | None | |
Densely Connected Convolutional Networks | 25 aug 2016 | arxiv | None | |
Residual Networks of Residual Networks: Multilevel Residual Networks | 9 aug 2016 | arxiv | None | |
Context Matters: Refining Object Detection in Video with Recurrent Neural Networks | 15 jul 2016 | arxiv | None | |
R-FCN: Object Detection via Region-based Fully Convolutional Networks | 20 may 2016 | arxiv | None | |
Training Region-based Object Detectors with Online Hard Example Mining | 12 apr 2016 | arxiv | None | |
T-CNN: Tubelets with Convolutional Neural Networks for Object Detection from Videos | 9 apr 2016 | arxiv | None | |
Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning | 23 feb 2016 | arxiv | None | |
Deep Residual Learning for Image Recognition | 10 dec 2015 | arxiv | None | |
SSD: Single Shot MultiBox Detector | 8 dec 2015 | arxiv | ||
Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs) | 23 nov 2015 | arxiv | None | |
ParseNet: Looking Wider to See Better | 15 jun 2015 | arxiv | None | |
You Only Look Once: Unified, Real-Time Object Detection | 8 jun 2015 | arxiv | ||
Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks | 4 jun 2015 | arxiv | ||
Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification | 6 feb 2015 | arxiv | None | |
Deep Image: Scaling up Image Recognition | 13 jan 2015 | arxiv | None | |
Rich feature hierarchies for accurate object detection and semantic segmentation | 11 nov 2013 | arxiv | None | |
Selective Search for Object Recognition | 11 mar 2013 | paper | None | |
ImageNet Classification with Deep Convolutional Neural Networks | 3 dec 2012 | paper |
Logo Recognition
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Deep Learning Logo Detection with Data Expansion by Synthesising Context | 29 dec 2016 | arxiv | None | |
Automatic Graphic Logo Detection via Fast Region-based Convolutional Networks | 20 apr 2016 | arxiv | None | |
LOGO-Net: Large-scale Deep Logo Detection and Brand Recognition with Deep Region-based Convolutional Networks | 8 nov 2015 | arxiv | None | |
DeepLogo: Hitting Logo Recognition with the Deep Neural Network Hammer | 7 okt 2015 | arxiv | None |
Super Resolution
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Network | 16 sep 2016 | arxiv | None | |
Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network | 15 sep 2016 | arxiv | None | |
RAISR: Rapid and Accurate Image Super Resolution | 3 jun 2016 | arxiv | None | |
Perceptual Losses for Real-Time Style Transfer and Super-Resolution | 27 mar 2016 | arxiv | github | None |
Image Super-Resolution Using Deep Convolutional Networks | 31 dec 2014 | arxiv | None |
Pose Estimation
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Forecasting Human Dynamics from Static Images | 11 apr 2017 | arxiv | None | |
Fast Single Shot Detection and Pose Estimation | 19 sep 2016 | arxiv | None | |
Convolutional Pose Machines | 30 jan 2016 | arxiv | None | |
Flowing ConvNets for Human Pose Estimation in Videos | 9 jun 2015 | arxiv | None |
Image Captioning
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Actor-Critic Sequence Training for Image Captioning | 29 jun 2017 | arxiv | None | |
Detecting and Recognizing Human-Object Interactions | 24 apr 2017 | arxiv | None | |
Deep Reinforcement Learning-based Image Captioning with Embedding Reward | 12 apr 2017 | arxiv | ||
Towards Diverse and Natural Image Descriptions via a Conditional GAN | 17 mar 2017 | arxiv | None | |
Temporal Tessellation: A Unified Approach for Video Analysis | 21 dec 2016 | arxiv | github | None |
Self-critical Sequence Training for Image Captioning | 2 dec 2016 | arxiv | None | |
Generation and Comprehension of Unambiguous Object Descriptions | 7 nov 2015 | arxiv | None | |
Show, Attend and Tell: Neural Image Caption Generation with Visual Attention | 10 feb 2015 | arxiv | None | |
Long-term Recurrent Convolutional Networks for Visual Recognition and Description | 17 nov 2014 | arxiv | None |
Image Compression
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Full Resolution Image Compression with Recurrent Neural Networks | 18 aug 2016 | arxiv | None |
Image Synthesis
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
A Neural Representation of Sketch Drawings | 11 apr 2017 | arxiv | None | |
BEGAN: Boundary Equilibrium Generative Adversarial Networks | 31 mar 2017 | arxiv | github | None |
Improved Training of Wasserstein GANs | 31 mar 2017 | arxiv | None | |
Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networks | 30 mar 2017 | arxiv | github | None |
Wasserstein GAN | 26 jan 2017 | arxiv | None | |
RenderGAN: Generating Realistic Labeled Data | 4 nov 2016 | arxiv | None | |
Conditional Image Generation with PixelCNN Decoders | 16 jun 2016 | arxiv | None | |
Pixel Recurrent Neural Networks | 25 jan 2016 | arxiv | None | |
Generative Adversarial Networks | 10 jun 2014 | arxiv | None |
Face Recognition
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Accessorize to a Crime: Real and Stealthy Attacks on State-of-the-Art Face Recognition | 24 okt 2016 | paper | None | |
OpenFace: A general-purpose face recognition library with mobile applications | 1 jun 2016 | paper | None | |
Emotion Recognition in the Wild via Convolutional Neural Networks and Mapped Binary Patterns | 9 nov 2015 | paper | None | |
Deep Face Recognition | 7 sep 2015 | paper | None | |
Compact Convolutional Neural Network Cascade for Face Detection | 6 aug 2015 | arxiv | None | |
Learning Robust Deep Face Representation | 17 jul 2015 | arxiv | None | |
Facenet: A unified embedding for face recognition and clustering | 12 jun 2015 | paper | None | |
Multi-view Face Detection Using Deep Convolutional Neural Networks | 10 feb 2015 | arxiv | None |
Audio
Audio Synthesis
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Deep Cross-Modal Audio-Visual Generation | 26 apr 2017 | arxiv | None | |
A Neural Parametric Singing Synthesizer | 12 apr 2017 | arxiv | None | |
Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders | 5 apr 2017 | arxiv | github | None |
Tacotron: Towards End-to-End Speech Synthesis | 29 mar 2017 | arxiv | github | None |
Deep Voice: Real-time Neural Text-to-Speech | 25 feb 2017 | arxiv | None | |
WaveNet: A Generative Model for Raw Audio | 12 sep 2016 | arxiv | github | None |
Other
Unclassified
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
A simple neural network module for relational reasoning | 5 jun 2017 | arxiv | ||
Deep Complex Networks | 27 may 2017 | arxiv | github | None |
Learning to Fly by Crashing | 19 apr 2017 | arxiv | None | |
Who Said What: Modeling Individual Labelers Improves Classification | 26 mar 2017 | arxiv | None | |
Semi-supervised Knowledge Transfer for Deep Learning from Private Training Data | 18 okt 2016 | arxiv | None | |
DeepMath - Deep Sequence Models for Premise Selection | 14 jun 2016 | arxiv | None | |
Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue | 16 mar 2016 | arxiv | None | |
Long Short-Term Memory | 15 nov 1997 | paper | None |
Regularization
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Self-Normalizing Neural Networks | 8 jun 2017 | arxiv | ||
Concrete Dropout | 22 may 2017 | arxiv | github | None |
Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning | 6 jun 2015 | arxiv | None | |
Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift | 11 feb 2015 | arxiv | None |
Neural Network Compression
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Design of Efficient Convolutional Layers using Single Intra-channel Convolution, Topological Subdivisioning and Spatial "Bottleneck" Structure | 15 aug 2016 | arxiv | None | |
SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5MB model size | 24 feb 2016 | arxiv | None | |
Deep Compression: Compressing Deep Neural Networks with Pruning, Trained Quantization and Huffman Coding | 1 okt 2015 | arxiv | None |
Optimizers
Title | Date | Paper | Code | Labels |
---|---|---|---|---|
Accurate, Large Minibatch SGD: Training ImageNet in 1 Hour | 8 jun 2017 | arxiv | ||
Equilibrated adaptive learning rates for non-convex optimization | 15 feb 2015 | arxiv | None | |
Adam: A Method for Stochastic Optimization | 22 dec 2014 | arxiv | None | |
Deep learning with Elastic Averaging SGD | 20 dec 2014 | arxiv | None | |
ADADELTA: An Adaptive Learning Rate Method | 22 dec 2012 | arxiv | None | |
Advances in Optimizing Recurrent Networks | 4 dec 2012 | arxiv | None | |
Efficient Backprop | 1 jul 1998 | paper |