BriefGPT.xyz
Jul, 2020
转移差异:量化表示之间的差异
Transferred Discrepancy: Quantifying the Difference Between Representations
HTML
PDF
Yunzhen Feng, Runtian Zhai, Di He, Liwei Wang, Bin Dong
TL;DR
本研究提出了一种新的度量标准,即转移差异(TD),它基于下游任务表现来定义两个表示之间的差异,并展示了TD如何与下游任务相关,需要根据此类任务来定义指标,可用于评估不同训练策略的有效性。
Abstract
Understanding what information
neural networks
capture is an essential problem in
deep learning
, and studying whether different models capture similar features is an initial step to achieve this goal. Previous wo
→