We present TDNet, a temporally distributed network designed for fast and
accurate video semantic segmentation. We observe that features extracted from a
certain high-level layer of a deep CNN can be approximated by composing
features extracted from several shallower sub-networks. Leveraging the inherent
temporal continuity in videos, we distribute these sub-networks over sequential
frames. Therefore, at each time step, we only need to perform a lightweight
computation to extract a sub-features group from a single sub-network. The full
features used for segmentation are then recomposed by application of a novel
attention propagation module that compensates for geometry deformation between
frames. A grouped knowledge distillation loss is also introduced to further
improve the representation power at both full and sub-feature levels.
Experiments on Cityscapes, CamVid, and NYUD-v2 demonstrate that our method
achieves state-of-the-art accuracy with significantly faster speed and lower
latency.

该研究提出了一种名为 TDNet 的时态分布网络，旨在实现快速准确的视频语义分割，该网络使用深度卷积神经网络从视频中提取特征，并通过逐帧分布的方式，引入了新颖的注意力传播模块和分组知识蒸馏损失函数，从而达到了较高的分割准确率和更低的延迟。