xkevin11 / deep-learning

Geek Repo:Geek Repo

Github PK Tool:Github PK Tool

Deep-Learning

Useful Resources

Keras Tutorial : The Ultimate Beginner’s Guide to Deep Learning in Python https://elitedatascience.com/keras-tutorial-deep-learning-in-python

5 Genius Python Deep Learning Libraries https://elitedatascience.com/python-deep-learning-libraries#keras

  1. Theano is a low-level library that specializes in efficient computation. You’ll only use this directly if you need fine-grain customization and flexibility.
  2. TensorFlow is another low-level library that is less mature than Theano. However, it’s supported by Google and offers out-of-the-box distributed computing.
  3. Lasagne is a lightweight wrapper for Theano. Use this if need the flexibility of Theano but don’t want to always write neural network layers from scratch.
  4. Keras is a heavyweight wrapper for both Theano and Tensorflow. It’s minimalistic, modular, and awesome for rapid experimentation. This is our favorite Python library for deep learning and the best place to start for beginners.
  5. MXNet is another high-level library similar to Keras. It offers bindings for multiple languages and support for distributed computing.

KDnuggest - 7 Steps to Mastering Deep Learning with Keras https://www.kdnuggets.com/2017/10/seven-steps-deep-learning-keras.html

GPU

[2018-09-02] So I managed to get a CNN model working on my MacBook Pro (see keras_deep_learning.py) to learn MNIST dataset. The forecast accuracy on test set was over 99%!! However, using CPU it took > 40 min to train, which is too slow. TensorFlow no longer provides GPU support on macOS either as of version 1.2.

Question - which of the below?

  1. e-GPU
  2. AWS EC2
  3. Google Colaboratory: training completes in 212 seconds!! Improvement by X11.3

Tensorflow : GPU vs CPU CPU - 176 s, GPU (GTX1080) - 8 s

e-GPU

StackOverflow

Kaggle thread

NVIDIA Titan Xp

Picking a GPU for Deep Learning

Siraj

  • High budget: Titan XP
  • Moderate Budget: GTX 1060
  • TIght Budget: GTX 1050 TI

About


Languages

Language:Python 100.0%