BriefGPT.xyz
Feb, 2023
软阈值剪枝的统一框架
A Unified Framework for Soft Threshold Pruning
HTML
PDF
Yanqi Chen, Zhengyu Ma, Wei Fang, Xiawu Zheng, Zhaofei Yu...
TL;DR
本研究提出了一种软阈值剪枝算法,将其重构为使用迭代收缩阈值算法(ISTA)求解的隐式优化问题,并以此推导出优化阈值的最佳调度器及其它剪枝算法,该剪枝算法在ResNet-50,MobileNet-V1和SEW ResNet-18等图像数据集上表现出卓越的性能。
Abstract
soft threshold pruning
is among the cutting-edge pruning methods with state-of-the-art performance. However, previous methods either perform aimless searching on the
threshold scheduler
or simply set the threshol
→