rgtjf / ecnunlp-tensorflow-tutorial

Tensorflow Tutorial

ecnunlp-tensorflow-tutorial

Tensorflow Tutorial, especially in NLP.

• ppt, paper, code

Refs

• http://adventuresinmachinelearning.com/python-tensorflow-tutorial/
• https://www.tensorflow.org/tutorials/layers
• TensorFlow-Examples

Outline

How to install

• Install CUDA
• install tensorflow

  pip install tensorflow-gpu==1.0.1
  # or
  pip install tensorflow-gpu==1.2.0

Background

• computation graph
• sess, feed_dict, functions

Run a model

• CNN/LSTM/attention
• objective function
• seq2seq

Hyper-parameters

• optimizer
• learning rate
• dropout

Homework

• text classifcation task

More

• reinforcement learning
• gan
• resnet

Pytorch

• pytorch nlp

---

Update 2017.10.30

Homework

• tf-classifcation

---

Update 2017.11.18

Lecture 1

• Tensorflow, Computation Graph, Placeholder, Variables, Operations
• data(x, y), model(train, predict), main(feed_dict, session)
• broadcast, conv2d
• Tensorflow in NLP, word embeddings, padding, mask
• Task, nlpcc2017_news_headline_categorization

Lecture 2

• BiLSTM (BasicLSTMCell, bidirectional_dynamic_rnn, outputs, state)
• RNN (vanish gradient)
  • clipper
  • carefully init, sigmoid -> tanh/relu
  • add memory cell: LSTM (input gate, forget gate, output gate), GRU (reset gate, update gate)
• Attention
• GAN
  • generator, discriminator