Few-shot learning is challenging for learning algorithms that learn each task
in isolation and from scratch. In contrast, meta-learning learns from many
related tasks a meta-learner that can learn a new task more accurately and
faster with fewer examples, where the choice of meta-learners is crucial. In
this paper, we develop Meta-SGD, an SGD-like, easily trainable meta-learner
that can initialize and adapt any differentiable learner in just one step, on
both supervised learning and reinforcement learning. Compared to the popular
meta-learner LSTM, Meta-SGD is conceptually simpler, easier to implement, and
can be learned more efficiently. Compared to the latest meta-learner MAML,
Meta-SGD has a much higher capacity by learning to learn not just the learner
initialization, but also the learner update direction and learning rate, all in
a single meta-learning process. Meta-SGD shows highly competitive performance
for few-shot learning on regression, classification, and reinforcement
learning.

本文介绍 Meta-SGD，一种高容量，容易训练的元学习器，可以在监督学习和强化学习中初始化和适应任何可微分的学习器，在单次元学习过程中学习学习器初始化、更新方向和学习率，相较于 LSTM 和 MAML 在少样本学习上表现更加具有竞争性。