BriefGPT.xyz
Feb, 2022
粗化粒度:朝向结构稀疏的彩票神经元
Coarsening the Granularity: Towards Structurally Sparse Lottery Tickets
HTML
PDF
Tianlong Chen, Xuxi Chen, Xiaolong Ma, Yanzhi Wang, Zhangyang Wang
TL;DR
本文提出一种新方法,通过迭代的裁剪与一系列“后处理技术”,找到带有结构化稀疏性的获奖子网络,从而在不影响模型精度的情况下,显著提高模型的推理速度。
Abstract
The
lottery ticket hypothesis
(LTH) has shown that dense models contain highly sparse subnetworks (i.e.,
winning tickets
) that can be trained in isolation to match full accuracy. Despite many exciting efforts bei
→