BriefGPT.xyz
May, 2021
基于Bregman学习框架的稀疏神经网络
A Bregman Learning Framework for Sparse Neural Networks
HTML
PDF
Leon Bungert, Tim Roith, Daniel Tenbrinck, Martin Burger
TL;DR
提出一种基于随机Bregman迭代的学习框架,用于训练稀疏神经网络,采用逆比例空间方法。该方法具有很高的效率和易实现性,且在ResNet-18的参数中仅用了3.4%,达到90.2%的CIFAR-10测试准确率。同时,利用该框架还可以进行稀疏反向传播和资源友好型训练。
Abstract
We propose a learning framework based on
stochastic bregman iterations
to train
sparse neural networks
with an
inverse scale space
approac
→