Catastrophic forgetting refers to the tendency that a neural network
"forgets" the previous learned knowledge upon learning new tasks. Prior methods
have been focused on overcoming this problem on convolutional neural networks
(CNNs), where the input samples like images lie in a grid domain, but have
largely overlooked graph neural networks (GNNs) that handle non-grid data. In
this paper, we propose a novel scheme dedicated to overcoming catastrophic
forgetting problem and hence strengthen continual learning in GNNs. At the
heart of our approach is a generic module, termed as topology-aware weight
preserving~(TWP), applicable to arbitrary form of GNNs in a plug-and-play
fashion. Unlike the main stream of CNN-based continual learning methods that
rely on solely slowing down the updates of parameters important to the
downstream task, TWP explicitly explores the local structures of the input
graph, and attempts to stabilize the parameters playing pivotal roles in the
topological aggregation. We evaluate TWP on different GNN backbones over
several datasets, and demonstrate that it yields performances superior to the
state of the art. Code is publicly available at
https://github.com/hhliu79/TWP.

该论文提出一种基于拓扑感知的权重保留 (TWP) 模块的方案，该模块针对图神经网络 (GNNs) 的持续学习问题，通过探索输入图的局部结构，稳定在拓扑聚合中起关键作用的参数，防止网络遗忘先前学习的知识，并证明该模块在多个数据集上的性能优于现有技术。