A common problem in Message-Passing Neural Networks is oversquashing -- the
limited ability to facilitate effective information flow between distant nodes.
Oversquashing is attributed to the exponential decay in information
transmission as node distances increase. This paper introduces a novel
perspective to address oversquashing, leveraging properties of global and local
non-dissipativity, that enable the maintenance of a constant information flow
rate. Namely, we present SWAN, a uniquely parameterized model GNN with
antisymmetry both in space and weight domains, as a means to obtain
non-dissipativity. Our theoretical analysis asserts that by achieving these
properties, SWAN offers an enhanced ability to transmit information over
extended distances. Empirical evaluations on synthetic and real-world
benchmarks that emphasize long-range interactions validate the theoretical
understanding of SWAN, and its ability to mitigate oversquashing.

该论文介绍了一种解决过度压缩问题的新方法，利用全局和局部非耗散性的属性，通过 SWAN 模型实现了信息的稳定流动速率。理论分析和对合成和真实世界基准的实证评估验证了 SWAN 的理论理解和其减轻过度压缩的能力。