As transfer learning techniques are increasingly used to transfer knowledge
from the source model to the target task, it becomes important to quantify
which source models are suitable for a given target task without performing
computationally expensive fine tuning. In this work, we propose HASTE (HArd
Subset TransfErability), a new strategy to estimate the transferability of a
source model to a particular target task using only a harder subset of target
data. By leveraging the internal and output representations of model, we
introduce two techniques, one class agnostic and another class specific, to
identify harder subsets and show that HASTE can be used with any existing
transferability metric to improve their reliability. We further analyze the
relation between HASTE and the optimal average log likelihood as well as
negative conditional entropy and empirically validate our theoretical bounds.
Our experimental results across multiple source model architectures, target
datasets, and transfer learning tasks show that HASTE modified metrics are
consistently better or on par with the state of the art transferability
metrics.

本文提出 HASTE（HArd Subset TransfErability）方法，通过使用较难的目标数据子集来估计源模型转移到特定目标任务的可转移性，结合内部和输出表示方法提出两种技术来识别较困难的子集，从而可与任何现有可迁移度度量一起使用以提高其可靠性，实验结果表明，HASTE 修改的指标与现有的可迁移度指标一致或更佳。