MetaLearningPapers
A summary of meta learning papers based on taxonomic category. Sorted by submitted date on arXiv.
Survey
Meta-Learning[paper]
- Joaquin Vanschoren
Meta-Learning: A Survey [paper]
- Joaquin Vanschoren
Meta-learners’ learning dynamics are unlike learners’ [paper]
- Neil C. Rabinowitz
Few-shot learning
Learning from the Past: Continual Meta-Learning with Bayesian Graph Neural Networks [paper]
- Yadan Luo, Zi Huang, Zheng Zhang, Ziwei Wang, Mahsa Baktashmotlagh, Yang Yang --arXiv 2019
PANet: Few-Shot Image Semantic Segmentation with Prototype Alignment [paper]
- Kaixin Wang, Jun Hao Liew, Yingtian Zou, Daquan Zhou, Jiashi Feng --ICCV 2019
Few-Shot Learning with Global Class Representations [paper]
- Tiange Luo, Aoxue Li, Tao Xiang, Weiran Huang, Liwei Wang --ICCV 2019
TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot Learning [paper]
- Sung Whan Yoon, Jun Seo, Jaekyun Moon --ICML 2019
Learning to Learn with Conditional Class Dependencies [paper]
- Xiang Jiang, Mohammad Havaei, Farshid Varno, Gabriel Chartrand, Nicolas Chapados, Stan Matwin --ICLR 2019
TAFE-Net: Task-Aware Feature Embeddings for Low Shot Learning [paper]
- Xin Wang, Fisher Yu, Ruth Wang, Trevor Darrell, Joseph E. Gonzalez --CVPR 2019
Variational Prototyping-Encoder: One-Shot Learning with Prototypical Images [paper]
- Junsik Kim, Tae-Hyun Oh, Seokju Lee, Fei Pan, In So Kweon --CVPR 2019
LCC: Learning to Customize and Combine Neural Networks for Few-Shot Learning [paper]
- Yaoyao Liu, Qianru Sun, An-An Liu, Yuting Su, Bernt Schiele, Tat-Seng Chua --CVPR 2019
Meta-Learning with Differentiable Convex Optimization [paper]
- Kwonjoon Lee, Subhransu Maji, Avinash Ravichandran, Stefano Soatto --CVPR 2019
Dense Classification and Implanting for Few-Shot Learning [paper]
- Yann Lifchitz, Yannis Avrithis, Sylvaine Picard, Andrei Bursuc --CVPR 2019
Meta-Dataset: A Dataset of Datasets for Learning to Learn from Few Examples
- Eleni Triantafillou, Tyler Zhu, Vincent Dumoulin, Pascal Lamblin, Kelvin Xu, Ross Goroshin, Carles Gelada, Kevin Swersky, Pierre-Antoine Manzagol, Hugo Larochelle -- arXiv 2019
Adaptive Cross-Modal Few-Shot Learning [paper]
- Chen Xing, Negar Rostamzadeh, Boris N. Oreshkin, Pedro O. Pinheiro --arXiv 2019
Meta-Learning with Latent Embedding Optimization [paper]
- Andrei A. Rusu, Dushyant Rao, Jakub Sygnowski, Oriol Vinyals, Razvan Pascanu, Simon Osindero, Raia Hadsell -- ICLR 2019
A Closer Look at Few-shot Classification [paper]
- Wei-Yu Chen, Yen-Cheng Liu, Zsolt Kira, Yu-Chiang Frank Wang, Jia-Bin Huang -- ICLR 2019
Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learning [paper]
- Yanbin Liu, Juho Lee, Minseop Park, Saehoon Kim, Eunho Yang, Sung Ju Hwang, Yi Yang -- ICLR 2019
Dynamic Few-Shot Visual Learning without Forgetting [paper]
- Spyros Gidaris, Nikos Komodakis --arXiv 2019
Meta Learning with Lantent Embedding Optimization [paper] -Andrei A. Rusu, Dushyant Rao, Jakub Sygnowski, Oriol Vinyals, Razvan Pascanu, Simon Osindero & Raia Hadsell --ICLR 2019
Adaptive Posterior Learning: few-shot learning with a surprise-based memory module
- Tiago Ramalho, Marta Garnelo --ICLR 2019
How To Train Your MAML [paper]
- Antreas Antoniou, Harrison Edwards, Amos Storkey -- ICLR 2019
TADAM: Task dependent adaptive metric for improved few-shot learning [paper]
- Boris N. Oreshkin, Pau Rodriguez, Alexandre Lacoste --arXiv 2019
Few-shot Learning with Meta Metric Learners
- Yu Cheng, Mo Yu, Xiaoxiao Guo, Bowen Zhou --NIPS 2017 workshop on Meta-Learning
Learning Embedding Adaptation for Few-Shot Learning [paper]
- Han-Jia Ye, Hexiang Hu, De-Chuan Zhan, Fei Sha --arXiv 2018
Meta-Transfer Learning for Few-Shot Learning [paper]
- Qianru Sun, Yaoyao Liu, Tat-Seng Chu, Bernt Schiele -- arXiv 2018
Task-Agnostic Meta-Learning for Few-shot Learning
- Muhammad Abdullah Jamal, Guo-Jun Qi, and Mubarak Shah --arXiv 2018
Few-Shot Learning with Graph Neural Networks [paper]
- Victor Garcia, Joan Bruna -- ICLR 2018
Prototypical Networks for Few-shot Learning [paper]
- Jake Snell, Kevin Swersky, Richard S. Zemel -- NIPS 2017
Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks [paper]
- Chelsea Finn, Pieter Abbeel, Sergey Levine -- ICML 2016
Large scale dataset
Image Deformation Meta-Networks for One-Shot Learning [paper]
- Zitian Chen, Yanwei Fu, Yu-Xiong Wang, Lin Ma, Wei Liu, Martial Hebert --CVPR 2019
Imbalance class
Learning to Model the Tail [paper]
- Yu-Xiong Wang, Deva Ramanan, Martial Hebert --NeurIPS 2017
NLP
Learning to Few-Shot Learn Across Diverse Natural Language Classification Tasks [paper]
- Trapit Bansal, Rishikesh Jha, Andrew McCallum --arXiv
Few-Shot Representation Learning for Out-Of-Vocabulary Words [paper]
- Ziniu Hu, Ting Chen, Kai-Wei Chang, Yizhou Sun --ACL 2019
Architecture search
Graph HyperNetworks for Neural Architecture Search [paper]
- Chris Zhang, Mengye Ren, Raquel Urtasun --ICLR 2019
Fast Task-Aware Architecture Inference
- Efi Kokiopoulou, Anja Hauth, Luciano Sbaiz, Andrea Gesmundo, Gabor Bartok, Jesse Berent --arXiv 2019
Bayesian Meta-network Architecture Learning
- Albert Shaw, Bo Dai, Weiyang Liu, Le Song --arXiv 2018
Task-dependent
Multimodal Model-Agnostic Meta-Learning via Task-Aware Modulation [paper] -Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim --NeurIPS 2019
Meta-Learning with Warped Gradient Descent [paper] -Sebastian Flennerhag, Andrei A. Rusu, Razvan Pascanu, Hujun Yin, Raia Hadsell --arXiv 2019
TAFE-Net: Task-Aware Feature Embeddings for Low Shot Learning [paper]
- Xin Wang, Fisher Yu, Ruth Wang, Trevor Darrell, Joseph E. Gonzalez --CVPR 2019
TapNet: Neural Network Augmented with Task-Adaptive Projection for Few-Shot Learning [paper]
- Sung Whan Yoon, Jun Seo, Jaekyun Moon --ICML 2019
Meta-Learning with Latent Embedding Optimization [paper]
- Andrei A. Rusu, Dushyant Rao, Jakub Sygnowski, Oriol Vinyals, Razvan Pascanu, Simon Osindero, Raia Hadsell -- ICLR 2019
Fast Task-Aware Architecture Inference
- Efi Kokiopoulou, Anja Hauth, Luciano Sbaiz, Andrea Gesmundo, Gabor Bartok, Jesse Berent --arXiv 2019
Task2Vec: Task Embedding for Meta-Learning
- Alessandro Achille, Michael Lam, Rahul Tewari, Avinash Ravichandran, Subhransu Maji, Charless Fowlkes, Stefano Soatto, Pietro Perona--arXiv 2019
TADAM: Task dependent adaptive metric for improved few-shot learning
- Boris N. Oreshkin, Pau Rodriguez, Alexandre Lacoste --arXiv 2019
MetaReg: Towards Domain Generalization using Meta-Regularization [paper]
- Yogesh Balaji, Swami Sankaranarayanan -- NIPS 2018
Heterogeneous task
Statistical Model Aggregation via Parameter Matching [paper]
- Mikhail Yurochkin, Mayank Agarwal, Soumya Ghosh, Kristjan Greenewald, Trong Nghia Hoang --NeurIPS 2019
Hierarchically Structured Meta-learning [paper]
- Huaxiu Yao, Ying Wei, Junzhou Huang, Zhenhui Li --ICML 2019
Hierarchical Meta Learning [paper]
- Yingtian Zou, Jiashi Feng --arXiv 2019
Lifelong learning
Online Meta-Learning [paper]
- Chelsea Finn, Aravind Rajeswaran, Sham Kakade, Sergey Levine --ICML 2019
Hierarchically Structured Meta-learning [paper]
- Huaxiu Yao, Ying Wei, Junzhou Huang, Zhenhui Li --ICML 2019
A Neural-Symbolic Architecture for Inverse Graphics Improved by Lifelong Meta-Learning [paper]
- Michael Kissner, Helmut Mayer --arXiv 2019
Incremental Learning-to-Learn with Statistical Guarantees [paper]
- Giulia Denevi, Carlo Ciliberto, Dimitris Stamos, Massimiliano Pontil --arXiv 2018
Domain generation
Learning to Generalize: Meta-Learning for Domain Generalization
- Da Li, Yongxin Yang, Yi-Zhe Song, Timothy M. Hospedales -- arXiv 2018
Bayesian inference
Meta-Amortized Variational Inference and Learning [paper]
- Mike Wu, Kristy Choi, Noah Goodman, Stefano Ermon --arXiv 2019
Amortized Bayesian Meta-Learning [paper]
- Sachin Ravi, Alex Beatson --ICLR 2019
Meta-Learning Priors for Efficient Online Bayesian Regression [paper]
- James Harrison, Apoorva Sharma, Marco Pavone --WAFR 2018
Probabilistic Model-Agnostic Meta-Learning [paper]
- Chelsea Finn, Kelvin Xu, Sergey Levine --arXiv 2018
Few-shot Autoregressive Density Estimation: Towards Learning to Learn Distributions [paper]
- Scott Reed, Yutian Chen, Thomas Paine, Aäron van den Oord, S. M. Ali Eslami, Danilo Rezende, Oriol Vinyals, Nando de Freitas --ICLR 2018
Bayesian Model-Agnostic Meta-Learning [paper]
- Taesup Kim, Jaesik Yoon, Ousmane Dia, Sungwoong Kim, Yoshua Bengio, Sungjin Ahn -- NIPS 2018
Meta-learning by adjusting priors based on extended PAC-Bayes theory [paper]
- Ron Amit , Ron Meir --ICML 2018
Learning curves
Meta-Curvature [paper]
- Eunbyung Park, Junier B. Oliva --arXiv 2019
Configuration transfer
Fast Context Adaptation via Meta-Learning [paper]
- Luisa M Zintgraf, Kyriacos Shiarlis, Vitaly Kurin, Katja Hofmann, Shimon Whiteson --ICML 2019
Zero-Shot Knowledge Distillation in Deep Networks [paper]
- Gaurav Kumar Nayak *, Konda Reddy Mopuri, Vaisakh Shaj, R. Venkatesh Babu, Anirban Chakraborty --ICML 2019
Toward Multimodal Model-Agnostic Meta-Learning [paper]
- Risto Vuorio, Shao-Hua Sun, Hexiang Hu, Joseph J. Lim --arXiv 2019
Unsupervised learning
Unsupervised Learning via Meta-Learning [paper]
- Kyle Hsu, Sergey Levine, Chelsea Finn -- ICLR 2019
Meta-Learning Update Rules for Unsupervised Representation Learning [paper]
- Luke Metz, Niru Maheswaranathan, Brian Cheung, Jascha Sohl-Dickstein --ICLR 2019
Gradient-Based Meta-Learning with Learned Layerwise Metric and Subspace [paper] -Kate Rakelly, Aurick Zhou, Deirdre Quillen, Chelsea Finn, Sergey Levine --ICML 2018
Hyperparameter
LCC: Learning to Customize and Combine Neural Networks for Few-Shot Learning [paper]
- Yaoyao Liu, Qianru Sun, An-An Liu, Yuting Su, Bernt Schiele, Tat-Seng Chua --CVPR 2019
Gradient-based Hyperparameter Optimization through Reversible Learning [paper]
- Dougal Maclaurin, David Duvenaud, Ryan P. Adams --ICML 2016
Model compression
N2N Learning: Network to Network Compression via Policy Gradient Reinforcement Learning
- Anubhav Ashok, Nicholas Rhinehart, Fares Beainy, Kris M. Kitani --ICLR 2018
Kernel learning
Deep Mean Functions for Meta-Learning in Gaussian Processes [paper]
- Vincent Fortuin, Gunnar Rätsch --arXiv 2019
Kernel Learning and Meta Kernels for Transfer Learning [paper]
- Ulrich Ruckert
Optimization
Model-Agnostic Meta-Learning using Runge-Kutta Methods [paper]
- Daniel Jiwoong Im, Yibo Jiang, Nakul Verma --arXiv
Learning to Optimize in Swarms [paper]
- Yue Cao, Tianlong Chen, Zhangyang Wang, Yang Shen --arXiv 2019
Meta-Learning with Warped Gradient Descent [paper] -Sebastian Flennerhag, Andrei A. Rusu, Razvan Pascanu, Hujun Yin, Raia Hadsell --arXiv 2019
Learning to Generalize to Unseen Tasks with Bilevel Optimization [paper]
- Hayeon Lee, Donghyun Na, Hae Beom Lee, Sung Ju Hwang --arXiv 2019
Learning to Optimize [paper]
- Ke Li Jitendra Malik --ICLR 2017
Gradient-based Hyperparameter Optimization through Reversible Learning [paper]
- Dougal Maclaurin, David Duvenaud, Ryan P. Adams --ICML 2016
Theory
On the Convergence Theory of Gradient-Based Model-Agnostic Meta-Learning Algorithms[paper]
- Alireza Fallah, Aryan Mokhtari, Asuman Ozdaglar --arXiv 2019
Meta-learners' learning dynamics are unlike learners' [paper]
- Neil C. Rabinowitz --arXiv 2019
Regret bounds for meta Bayesian optimization with an unknown Gaussian process prior [paper]
- Zi Wang, Beomjoon Kim, Leslie Pack Kaelbling --NeurIPS 2018
Incremental Learning-to-Learn with Statistical Guarantees [paper]
- Giulia Denevi, Carlo Ciliberto, Dimitris Stamos, Massimiliano Pontil --UAI 2018
Meta-learning by adjusting priors based on extended PAC-Bayes theory [paper]
- Ron Amit , Ron Meir --ICML 2018
Meta-Learning and Universality: Deep Representations and Gradient Descent can Approximate any Learning Algorithm[paper]
- Chelsea Finn, Sergey Levine --ICLR 2018
On the Convergence of Model-Agnostic Meta-Learning [paper]
- Noah Golmant
Fast Rates by Transferring from Auxiliary Hypotheses [paper]
- Ilja Kuzborskij, Francesco Orabona --arXiv 2014
Algorithmic Stability and Meta-Learning [paper]
- Andreas Maurer --JMLR 2005
Online convex optimization
Online Meta-Learning on Non-convex Setting [paper]
- Zhenxun Zhuang, Yunlong Wang, Kezi Yu, Songtao Lu --arXiv 2019
Adaptive Gradient-Based Meta-Learning Methods [paper]
- Mikhail Khodak, Maria-Florina Balcan, Ameet Talwalkar --NeurIPS 2019
Learning-to-Learn Stochastic Gradient Descent with Biased Regularization [paper]
- Giulia Denevi, Carlo Ciliberto, Riccardo Grazzi, Massimiliano Pontil --NeurIPS 2019
Provable Guarantees for Gradient-Based Meta-Learning
- Mikhail Khodak Maria-Florina Balcan Ameet Talwalkar --arXiv 2019