BriefGPT.xyz
Jul, 2022
DRESS:动态实时稀疏子网络
DRESS: Dynamic REal-time Sparse Subnets
HTML
PDF
Zhongnan Qu, Syed Shakib Sarwar, Xin Dong, Yuecheng Li, Ekin Sumbul...
TL;DR
本文提出了一种名为 DRESS 的新型训练算法,用于从同一主干网络中通过基于行的非结构稀疏性采样多个子网络,并通过加权损失并行训练这些子网络,以及利用参数重用和基于行的精细采样策略来实现高效存储和设备适应。在公共视觉数据集上的大量实验证明,DRESS比最先进的子网络具有显着更高的准确性。
Abstract
The limited and dynamically varied resources on edge devices motivate us to deploy an optimized
deep neural network
that can adapt its
sub-networks
to fit in different resource constraints. However, existing work
→