Deep leaning for Chatbot Developers

Introduction to NLP/Chatbot
Overview of Korean/English NLP Toolkits/Datasets
Tutorial (code)
- Introduction to spaCy / gensim / konlpy / other Korean toolkits
- Sentiment classification via TF-IDF (scikit-learn)
- Chatbot Pipelining / Serving via Kakaotalk (flask) / Slack (slacker)

CNN for text classification
- Word CNN / Dynamic CNN / Char CNN / Very Deep CNN
RNN for text classification
- Bidirectional RNN / Recursive NN / Tree LSTM / Dual Encoder LSTM
Advanced CNN/RNN architectures
- QRNN / SRU / ByteNet / SliceNet / LSTM-CNNs-CRF
Tutorial (code)
- Word-CNN for sentiment analysis
- PyTorch Style Guide
- TorchText Tutorial

Seq2Seq models for conversation modeling
- Seq2Seq / Neural Conversation model / Diversity-prompting objective: MMI
Advanced Seq2Seq architectures
- Show and Tell / HRED / VHRED / Personal based Neural Conversation model / Contextualized Word Vectors (CoVe)
Attention mechanism
- Bahdanau / Luong
- Global / Local
Advanced Attention architectures
- Show, Attend and Tell / Pointer Networks / CopyNet / BiDAF / Transformer
Tutorial (code)
- Seq2Seq with Attention for Machine Translation

QA with External Memory
- Memory Networks / End-to-End Memory Networks / Key-value Memory Networks / Neural Turing Machines
Advanced Memory architectures
- DNC / Life-long memory Modules / Context-Sequence Memory Networks
Advanced Dialogue Architectures
- MILABOT / Dialog based language learning / End-to-End Goal Oriented Dialog / Deep RL / Adversarial
Tutorial (code)
- End-to-End Memory Networks for Question Answering (bAbI)

Dependencies