BriefGPT.xyz
Dec, 2020
LieTransformer:李群中的等变自注意力
LieTransformer: Equivariant self-attention for Lie Groups
HTML
PDF
Michael Hutchinson, Charline Le Lan, Sheheryar Zaidi, Emilien Dupont, Yee Whye Teh...
TL;DR
本文提出了LieTransformer,这是一种由LieSelfAttention层组成的网络结构,可以处理不同类型的Lie群及其离散子群的不变性,并通过实验表现出一定的竞争力,可以在点云形状计数、分子属性回归、粒子在哈密顿动力学下的轨迹建模等方面提升数据效率。
Abstract
group equivariant neural networks
are used as building blocks of group invariant neural networks, which have been shown to improve generalisation performance and
data efficiency
through principled parameter shari
→