The field of meta-learning, or learning-to-learn, has seen a dramatic rise in interest in recent years. Contrary to conventional approaches to AI where a given task is solved from scratch using a fixed learning algorithm, meta-learning aims to improve the learning algorithm itself, given the experience of multiple learning episodes. This paradigm provides an opportunity to tackle many of the conventional challenges of deep learning, including data and computation bottlenecks, as well as the fundamental issue of generalization. In this survey we describe the contemporary meta-learning landscape. We first discuss definitions of meta-learning and position it with respect to related fields, such as transfer learning, multi-task learning, and hyperparameter optimization. We then propose a new taxonomy that provides a more comprehensive breakdown of the space of meta-learning methods today. We survey promising applications and successes of meta-learning including few-shot learning, reinforcement learning and architecture search. Finally, we discuss outstanding challenges and promising areas for future research.

该文总结了元学习（或学习-学习）领域的现状，旨在通过改进学习算法本身来解决深度学习中包括数据和计算瓶颈在内的传统挑战，并提出了一种更全面的元学习方法分类，并重点介绍了几个应用领域，如少样本学习和强化学习，并讨论了未来研究的未解决的问题和有前景的方向。

神经网络中的元学习：一份调查报告