Class-incremental learning (CIL) aims to train a model to learn new classes
from non-stationary data streams without forgetting old ones. In this paper, we
propose a new kind of connectionist model by tailoring neural unit dynamics
that adapt the behavior of neural networks for CIL. In each training session,
it introduces a supervisory mechanism to guide network expansion whose growth
size is compactly commensurate with the intrinsic complexity of a newly
arriving task. This constructs a near-minimal network while allowing the model
to expand its capacity when cannot sufficiently hold new classes. At inference
time, it automatically reactivates the required neural units to retrieve
knowledge and leaves the remaining inactivated to prevent interference. We name
our model AutoActivator, which is effective and scalable. To gain insights into
the neural unit dynamics, we theoretically analyze the model's convergence
property via a universal approximation theorem on learning sequential mappings,
which is under-explored in the CIL community. Experiments show that our method
achieves strong CIL performance in rehearsal-free and minimal-expansion
settings with different backbones.

基于神经元动力学调整的自激活模型，用于训练模型从非稳态数据流中学习新类别而不忘记旧类别，通过引入监督机制来指导网络扩展，使其在推理时自动激活所需的神经元单元以检索知识，从而在不同的背景下实现强大的增量学习性能。