Metric-based meta-learning has attracted a lot of attention due to its
effectiveness and efficiency in few-shot learning. Recent studies show that
metric scaling plays a crucial role in the performance of metric-based
meta-learning algorithms. However, there still lacks a principled method for
learning the metric scaling parameter automatically. In this paper, we recast
metric-based meta-learning from a Bayesian perspective and develop a
variational metric scaling framework for learning a proper metric scaling
parameter. Firstly, we propose a stochastic variational method to learn a
single global scaling parameter. To better fit the embedding space to a given
data distribution, we extend our method to learn a dimensional scaling vector
to transform the embedding space. Furthermore, to learn task-specific
embeddings, we generate task-dependent dimensional scaling vectors with
amortized variational inference. Our method is end-to-end without any
pre-training and can be used as a simple plug-and-play module for existing
metric-based meta-algorithms. Experiments on mini-ImageNet show that our
methods can be used to consistently improve the performance of existing
metric-based meta-algorithms including prototypical networks and TADAM. The
source code can be downloaded from
this https URL

本文从贝叶斯视角重新构建度量学习，在提出随机变分方法学习单个全局缩放参数的基础上，进一步生成任务依赖的尺度向量，实现纬度缩放以更好地适应给定的数据分布，为已有的度量学习算法提供可插拔的端到端方式并对 mini-ImageNet 数据集的表现进行实验。