BriefGPT.xyz
Jul, 2024
标签辅助下的强化教师:一种用于语义分割的新型知识蒸馏方法
Make a Strong Teacher with Label Assistance: A Novel Knowledge Distillation Approach for Semantic Segmentation
HTML
PDF
Shoumeng Qiu, Jie Chen, Xinrun Li, Ru Wan, Xiangyang Xue...
TL;DR
提出一种新的知识蒸馏方法,通过将标签噪声并结合到输入中来提高轻量级教师模型的性能,同时保持与标准蒸馏一致性训练学生模型,以提高知识蒸馏的效果并增加教师和学生模型的灵活性。
Abstract
In this paper, we introduce a novel
knowledge distillation
approach for the
semantic segmentation
task. Unlike previous methods that rely on power-trained teachers or other modalities to provide additional knowle
→