JeongHogok / learning_framework

Tensorflow, PyTorch, MxNet으로 기본 모델부터 다양한 ImageNet 등등이 구현되어 정리

Learning Python A.I Framework

• 본 Repository 는 지극히 개인적인 공부용이라 모든 코드들이 불친절하고 가독성이 좋지 않습니다.
• 대부분 Network만 구성해볼뿐 학습을 해보진 않습니다. (물론 추후에 학습도 해볼 예정)
• 현재 버전
  • TensorFlow: 2.3.1
  • PyTorch: 1.6
  • MXNet: 1.5

---

Framework list

TensorFlow

• 배포 : Google
• 공식 홈페이지 : https://www.tensorflow.org
• 주 사용 프레임워크
• Low level(tf.nn), High level(tf.keras), model subclassing API 로 작성하려함.
• 1.x -> 2.x 로 변겅중.

PyTorch

• 배포 : Facebook
• 공식 홈페이지 : https://pytorch.org
• 서브 프레임워크

MXNet

• 배포 : Apache
• 공식 홈페이지 : https://mxnet.apache.org
• 그냥...써보려고 함....
• Gluon, Module 로 작성하려함.
• 매우...진행이 느릴 것으로 예상.

JAX

• 배포 : Google
• 공식 홈페이지 : https://github.com/google/jax
• 그냥....써보려고....
• Transformer가 jax 기반이길래...

Example List

01 Basic Usage

• Linear Regression
  tf.keras, tf.nn, PyTorch, MXNet Gluon JAX

• Logistic Regression
  tf.keras, tf.nn, PyTorch, MXNet Gluon

02 Intermediate

• Multi Layer Network
  tf.keras, tf.nn, PyTorch MXNet Gluon

• Simple Convolutional Neural Network
  tf.keras, tf.nn, PyTorch MXNet Gluon

03 Advance

Advance Convolutional Neural Network

1. VGGNet (https://arxiv.org/abs/1409.1556)
   tf.keras, PyTorch, MXNet Gluon

2. GoogLeNet (https://arxiv.org/abs/1409.4842)
   tf.keras, PyTorch, MXNet Gluon

3. ResNet (https://arxiv.org/abs/1512.03385)
   tf.keras, PyTorch, MXNet Gluon

4. Inception V2 (https://arxiv.org/abs/1512.00567)
   tf.keras, PyTorch, MXNet Gluon

5. Inception V3 (https://arxiv.org/abs/1512.00567)
   tf.keras, PyTorch, MXNet Gluon

6. DenseNet (https://arxiv.org/abs/1608.06993)
   tf.keras, PyTorch, MXNet Gluon

7. Xception (https://arxiv.org/abs/1610.02357)
   tf.keras, PyTorch, MXNet Gluon

8. MobileNet V1 (https://arxiv.org/abs/1704.04861)
   tf.keras, PyTorch, MXNet Gluon

9. MobileNet V2 (https://arxiv.org/abs/1801.04381)
   tf.keras, PyTorch, MXNet Gluon

10. MobileNet V3 (https://arxiv.org/abs/1905.02244)
    tf.keras, PyTorch

11. SqueezeNet (https://arxiv.org/abs/1602.07360)
    tf.keras, PyTorch

12. SENet (https://arxiv.org/abs/1709.01507)
    tf.keras, PyTorch

Segmentation

1. DeconvNet (http://cvlab.postech.ac.kr/research/deconvnet/)
   PyTorch

2. U-Net (https://arxiv.org/abs/1505.04597)
   tf.keras, PyTorch

Generative Adversarial Network

1. Vanilla GAN
   tf.keras, PyTorch

2. LSGAN
   tf.keras, PyTorch

3. DCGAN
   tf.keras,
   PyTorch

4. CGAN
   tf.keras,
   PyTorch

04 Extra

Super Resolution

1. SRCNN
   TensorFlow, PyTorch

2. VDSR
   TensorFlow, PyTorch

3. EDSR
   TensorFlow, PyTorch

4. SubPixel
   TensorFlow, PyTorch

Image Translation

1. Neural Style Transfer
   PyTorch

2. Pix2Pix

3. CycleGAN

Attention Module

1. BAM

2. CBAM