BriefGPT.xyz
Jun, 2020
SGD超参数在自然训练中如何影响对抗鲁棒性?
How do SGD hyperparameters in natural training affect adversarial robustness?
HTML
PDF
Sandesh Kamath, Amit Deshpande, K V Subrahmanyam
TL;DR
通过实验观察SGD算法中学习率、batch size和momentum三个重要超参数对神经网络训练精度及对抗鲁棒性的影响,并发现固定学习率和batch size比例的训练方式可以获得更好的泛化能力与保持较为稳定的抗干扰性能。
Abstract
Learning rate,
batch size
and
momentum
are three important hyperparameters in the
sgd algorithm
. It is known from the work of Jastrzebski
→