nakosung / deep_architecture_genealogy

Deep Learning Architecture Genealogy Project

Deep Architecture Genealogy

There are so many new models and archtectures. If you find something inetresting and worth to pay attention, please let us know.

Mindmap Coggle Link

https://coggle.it/diagram/Wf5mYoJbsgABUF9P

Text Version

This is automatically generated. Please send a PR on the Neural Net Arch Genealogy.txt file.

• Memory Networks
  • Neural Programming
    • Neural Turing Machine,'14.10
    • Neural Random-Access Machines,'16.02
    • Hierarchical Attentive Memory, '16.02
    • Neural GPUs Learn Algorithms, '16.03
    • Neural Programmer,'16.08
    • Hybrid Computing, '16.10
  • Memory Networks,'14.10
  • End-to-End Memory Network,'15.03
  • Dynamic Memory Network
• CNN
  • AlexNet
  • VggNet
  • GoggleNet
  • ResNet
  • DenseNet
  • Object Detection
    • R-CNN
    • Fast R-CNN
    • Faster R-CNN
    • Mask R-CNN
  • Super-resolution
    • MemNet
    • FSRCNN
    • SRCNN
    • VDSR
    • DRCN
    • LabSRN
    • EDSR
• RNN
  • LSTM, '97.11
  • GRU, 14.11
  • ACT: Adaptive Computation Time
  • S2S: RNN Encoder-Decoder, '14.06
    • Attention: Jointly Learning to Align
      • Effective Approaches to Attention, Luong et al.
      • DCN: Dynamic Coattention Networks
      • DCN+
      • Transformer: Attention Is All You Need, '17.06
• Capsule Net
• Generative Models
  • Autoregressive models
    • MADE, '15.02.12
    • PixelRNN, '16.01.25
    • NADE, '16.05.07
    • PixelCNN, '16.06.16
    • PixelCNN++, '17.01.19
  • Latent variable models
    • VAE, '13.12.20
      • CVAE, '14.06.20
      • AAE, '15.11.18
      • AVB, '17.01.17
      • VQ-VAE, '17.11.2
    • GAN, '14.06.10
      • Variants
        • CGAN, '14.11.06
        • DCGAN, '15.11.19
        • infoGAN, '16.06.12
        • EBGAN, '16.09.11
        • ACGAN, '16.10.30
        • WGAN, '17.01.26
        • BEGAN, '17.02.27
        • WGAN-GP, '17.03.31
      • Applications
        • Pix2Pix, '16.11.21
        • PPGN, '16.11.30
        • StackGAN, '16.12.10
        • CycleGAN, '17.03.31

Contributions

Your pull requests and issues are always welcome.