Yonggan Fu, Han Guo, Meng Li, Xin Yang, Yining Ding...
TL;DR本文探索了一种名为Cyclic Precision Training (CPT)的新型低精度训练方法,其能够提升深度神经网络训练的时间和能量效率,并在五个数据集和十一种模型上进行了大量仿真和消融研究。
Abstract
Low-precision deep neural network (DNN) training has gained tremendous attention as reducing precision is one of the most effective knobs for boosting DNNs' training time/energy efficiency. In this paper, we atte