TL;DR提出一种新的用于深度学习的优化算法,Adaptive Learning-rates for Interpolation with Gradients(ALI-G)。
Abstract
The majority of modern deep learning models are able to interpolate the data: the empirical loss can be driven near zero on all samples simultaneously. In this work, we explicitly exploit this interpolation prope