Research Paper Reading List
A list of papers and resources I have read, am reading, or want to read. The majority are deep-learning research papers.
General Resources
Paper Lists
Click to expand!
Courses
Click to expand!
- CS231n: Convolutional Neural Networks for Visual Recognition, Free on Youtube
- Coursera: Machine Learning by Andrew Ng, Free on Coursera
Lab Blogs
Click to expand!
Personal Blogs
General Deep Learning
Papers
- The Limit of the Batch Size (2020), Yang You, Yuhui Wang, ect. [pdf]
- Why AI is Harder Than We Think (2021), Melanie Mitchell, ect. [pdf]
- Learning representations by back-propagating errors, 1986 pdf
- Importance of input data normalization for the application of neural networks to complex industrial problems, 1997 pdf
- Empirical Evaluation of Rectified Activations in Convolutional Network, 2015 pdf
- Rectifier Nonlinearities Improve Neural Network Acoustic Models pdf
Reinforcement Learning (RL)
Papers
- Counter-Strike Deathmatch with Large-Scale Behavioural Cloning (2021), Tim Pearce, Jun Zhu, ect. [pdf]
Computer Vision / CNN
Papers
- An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (2020) [pdf]
- Are we done with ImageNet? (2020) [pdf]
- Visualizing and Understanding Convolutional Networks (2013) [pdf
- ImageNet classification with deep convolutional neural networks pdf
- Going Deeper with Convolutions pdf
- Deep Residual Learning for Image Recognition pdf
- Backpropagation Applied to Handwritten Zip Code Recognition, 1997 pdf
- An Analysis of Deep Neural Network Models for Practical Applications, 2017 pdf
Natural Language Processing / RNNs / LLms
Papers
- PaLM: Scaling Language Modeling with Pathways (2022), Aakanksha Chowdhery, Sharan Narang, ect. [pdf]
- Will we run out of data? An analysis of the limits of scaling datasets in Machine Learning (2022), by Pablo Villalobos, Jaime Sevilla, ect. [pdf]
- Chain-of-Thought Prompting Elicits Reasoning in Large Language Models, (2023) pdf
- Reflexion: Language Agents with Verbal Reinforcement Learning, (2023) pdf
- Tree of Thoughts: Deliberate Problem Solving with Large Language Models, (2023) pdf
- Training language models to follow instructions with human feedback, (2022) pdf
- Constitutional AI: Harmlessness from AI Feedback, (2023) pdf
- Efficient Estimation of Word Representations in Vector Space, (2013) pdf
Adversarial Learning / GANs
Papers
- Generative Adversarial Networks (2014), Ian J. Goodfellow [pdf]
- Conditional Generative Adversarial Nets (2014), M. Mirza, S. Osindero [pdf]
- Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks (ICLR 2016), A. Radford [pdf]
- Progressive Growing of GANs for Improved Quality, Stability, and Variation (ICLR 2018), [pdf]
- MSG-GAN: Multi-Scale Gradients for Generative Adversarial Networks (2019), A. Karnewar, O. Wang [pdf]
- Spectral Normalization for Generative Adversarial Networks (ICLR 2018), [pdf]
Cellular Automata
Papers
- Real-Time Sorting of Binary Numbers on One-Dimensional CA, Thomas Worsch [pdf
- Rule 30
Miscellaneous
Paper
- Digitizing Chinese Books: A Case Study of the SuperStar DuXiu Scholar Search Engine (2009), Li Auigo [pdf]