BriefGPT.xyz
Jul, 2023
探索锐化余弦相似度
Exploring the Sharpened Cosine Similarity
HTML
PDF
Skyler Wu, Fred Lu, Edward Raff, James Holt
TL;DR
我们的工作中，我们探讨了Sharpened Cosine Similarity（SCS）参数的行为和潜力，并且研究了在多个卷积神经网络结构中用SCS替换卷积的效果。我们发现，虽然SCS可能不会显著提高准确性，但可能会学习到更易解释的表征。我们还发现，在某些情况下，SCS可能会略微提高对抗性的稳定性。
Abstract
convolutional layers
have long served as the primary workhorse for image classification. Recently, an alternative to convolution was proposed using the
sharpened cosine similarity
(SCS), which in theory may serve
→