BriefGPT.xyz
Apr, 2024
SDPose:基于循环引导自蒸馏的分词姿态估计
SDPose: Tokenized Pose Estimation via Circulation-Guide Self-Distillation
HTML
PDF
Sichen Chen, Yingyi Zhang, Siming Huang, Ran Yi, Ke Fan...
TL;DR
SDPose是一种新的自我蒸馏方法,它基于多周期前向传播设计了一个名为MCT的transformer模块来提高小型transformer模型的性能,同时通过将MCT模块的知识提取到一个简单的前向模型中,避免了额外的计算。
Abstract
Recently,
transformer-based methods
have achieved state-of-the-art prediction quality on
human pose estimation
(HPE). Nonetheless, most of these top-performing transformer-based models are too computation-consumin
→