BriefGPT.xyz
May, 2020
贝叶斯位: 统一量化和剪枝
Bayesian Bits: Unifying Quantization and Pruning
HTML
PDF
Mart van Baalen, Christos Louizos, Markus Nagel, Rana Ali Amjad, Ying Wang...
TL;DR
Bayesian Bits是一种通过梯度优化实现联合混合精度量化和剪枝的实用方法,其采用一种新的量化操作分解,并引入可学习的随机门,通过对门进行近似推理,可以获得精度与效率之间更好的平衡的剪枝混合精度网络。
Abstract
We introduce
bayesian bits
, a practical method for joint
mixed precision quantization
and
pruning
through gradient based optimization.
→