BriefGPT.xyz
Oct, 2022
深度学习中CKA作为相似度度量的可靠性
Reliability of CKA as a Similarity Measure in Deep Learning
HTML
PDF
MohammadReza Davari, Stefan Horoi, Amine Natik, Guillaume Lajoie, Guy Wolf...
TL;DR
通过分析 Centered Kernel Alignment 算法对于在机器学习中出现的简单变化的敏感度,我们研究了该算法的若干弱点,并探索了在保持功能行为的前提下改变 CKA 值的方法,结果表明 CKA 值可以容易地被操纵而不需对模型做实质性的改变,因此在利用活动对齐度量时需谨慎。
Abstract
Comparing learned
neural representations
in neural networks is a challenging but important problem, which has been approached in different ways. The
centered kernel alignment
(CKA) similarity metric, particularly
→