BriefGPT.xyz
Jan, 2023
16位浮点纯神经网络的潜在能量
The Hidden Power of Pure 16-bit Floating-Point Neural Networks
HTML
PDF
Juyoung Yun, Byungkon Kang, Zhoulai Fu
TL;DR
通过实验与理论分析，本文研究了纯16位神经网络在分类任务中的性能与效率，发现其在一定情况下可以取得比32位神经网络更好的结果。
Abstract
Lowering the
precision
of
neural networks
from the prevalent 32-bit
precision
has long been considered harmful to
→