BriefGPT.xyz
Jul, 2022
AdamNODEs:当神经常微分方程遇到自适应矩时估计
AdamNODEs: When Neural ODE Meets Adaptive Moment Estimation
HTML
PDF
Suneghyeon Cho, Sanghyun Hong, Kookjin Lee, Noseong Park
TL;DR
提出一种新的模型AdamNODEs,用来控制时间步中加速度的变化,从而提高neural ODEs的训练效果和稳定性,该模型比传统的基于动量的neural ODEs和其他方法具有更好的性能。
Abstract
Recent work by Xia et al. leveraged the continuous-limit of the classical
momentum
accelerated gradient descent and proposed heavy-ball
neural odes
. While this model offers
→