BriefGPT.xyz
Oct, 2023
自动使用梯度学习层间等变性
Learning Layer-wise Equivariances Automatically using Gradients
HTML
PDF
Tycho F. A. van der Ouderaa, Alexander Immer, Mark van der Wilk
TL;DR
卷积将等变对称性编码到神经网络中,从而提高泛化性能。为了允许灵活的对称约束,我们改进了软等变性的参数化,并通过优化边缘似然来学习层面的等变性。我们展示了在图像分类任务上自动学习层面等变性的能力,获得了与硬编码对称性基线相当或更好的性能。
Abstract
convolutions
encode
equivariance symmetries
into neural networks leading to better generalisation performance. However, symmetries provide fixed hard constraints on the functions a network can represent, need to
→