BriefGPT.xyz
Sep, 2023
DNNShifter: 边缘计算的高效DNN剪枝系统
DNNShifter: An Efficient DNN Pruning System for Edge Computing
HTML
PDF
Bailey J. Eccles, Philip Rodgers, Peter Kilpatrick, Ivor Spence, Blesson Varghese
TL;DR
DNNShifter是一个端到端的DNN训练、空间修剪和模型切换系统,通过采用结构化修剪的新方法,快速地生成适用于边缘推理的模型变体,这些模型变体比密集模型小且快速,并且在保持相似精度的同时,产生出高效的推理延迟和低开销模型切换和内存利用。
Abstract
deep neural networks
(DNNs) underpin many machine learning applications. Production quality DNN models achieve high
inference accuracy
by training millions of DNN parameters which has a significant resource footp
→