MMC Deep Learning experiments
2015-06-21
Literature
- Lecun, Bengio, Hinton, 2015, Deep Learning, http://www.nature.com/nature/journal/v521/n7553/full/nature14539.html
- Mikolov, Sutskever, Chen, Corrado, Dean, 2013, Distributed Representations of Words and Phrases and their Compositionality, http://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality
- Hinton, 1986, Learning distributed representations of concepts, http://www.cogsci.ucsd.edu/~ajyu/Teaching/Cogs202_sp13/Readings/hinton86.pdf
- Bengio, Ducharme, Vincent, Janvin, 2003, A neural probabilistic language model, http://machinelearning.wustl.edu/mlpapers/paper_files/BengioDVJ03.pdf
tutorial
- https://www.youtube.com/watch?v=S75EdAcXHKk
- https://www.kaggle.com/c/word2vec-nlp-tutorial/details/part-2-word-vectors
implementations
- linearregression.py : Theano example from tutorial to fit a least square.
- word2vec.py : Word2Vec from the Kaggle tutorial