Graph convolutional networks (GCNs) are nowadays becoming mainstream in
solving many image processing tasks including skeleton-based recognition. Their
general recipe consists in learning convolutional and attention layers that
maximize classification performances. With multi-head attention, GCNs are
highly accurate but oversized, and their deployment on edge devices requires
their pruning. Among existing methods, magnitude pruning (MP) is relatively
effective but its design is clearly suboptimal as network topology selection
and weight retraining are achieved independently. In this paper, we devise a
novel lightweight GCN design dubbed as Probabilistic Magnitude Pruning (PMP)
that jointly trains network topology and weights. Our method is variational and
proceeds by aligning the weight distribution of the learned networks with an a
priori distribution. This allows implementing any fixed pruning rate, and also
enhancing the generalization performances of the designed lightweight GCNs.
Extensive experiments conducted on the challenging task of skeleton-based
recognition show a substantial gain of our lightweight GCNs particularly at
very high pruning regimes.

本文介绍了一种新的轻量级 GCN 设计：概率幅值剪枝 (PMP)，该方法通过联合训练网络拓扑和权重，通过对齐已知先验分布的权重分布来实现任何固定剪枝率，以及增强设计的轻量级 GCN 的泛化性能。在处理基于骨骼的识别任务时，本文进行了大量的实验证明，轻量级 GCN 在非常高的剪枝基准下有显着的性能提升。