Real-life graph data often expands continually, rendering the learning of
graph neural networks (GNNs) on static graph data impractical. Graph continual
learning (GCL) tackles this problem by continually adapting GNNs to the
expanded graph of the current task while maintaining the performance over the
graph of previous tasks. Memory replay-based methods, which aim to replay data
of previous tasks when learning new tasks, have been explored as one principled
approach to mitigate the forgetting of the knowledge learned from the previous
tasks. In this paper we extend this methodology with a novel framework, called
Debiased Lossless Memory replay (DeLoMe). Unlike existing methods that sample
nodes/edges of previous graphs to construct the memory, DeLoMe learns small
lossless synthetic node representations as the memory. The learned memory can
not only preserve the graph data privacy but also capture the holistic graph
information, for which the sampling-based methods are not viable. Further,
prior methods suffer from bias toward the current task due to the data
imbalance between the classes in the memory data and the current data. A
debiased GCL loss function is devised in DeLoMe to effectively alleviate this
bias. Extensive experiments on four graph datasets show the effectiveness of
DeLoMe under both class- and task-incremental learning settings.

本文介绍了一种名为 DeLoMe 的新框架，它通过学习小型无损合成节点表示来构建记忆，以解决真实生活中图数据不断扩展的问题，并且在保持先前任务图的性能的同时，持续适应当前任务的扩展图。