BriefGPT.xyz
Dec, 2021
响应性网络压缩中蒸馏质量的控制
Controlling the Quality of Distillation in Response-Based Network Compression
HTML
PDF
Vibhas Vats, David Crandall
TL;DR
本文探讨了如何提高知识压缩的效果,发现教师神经网络的反应质量和相似性信息密切相关,而采用适当的批量和历元数训练教师可以提高知识压缩的效果。
Abstract
The performance of a
distillation
-based
compressed network
is governed by the quality of
distillation
. The reason for the suboptimal
→