BriefGPT.xyz
Jul, 2020
通过有限差分得分匹配高效学习生成模型
Efficient Learning of Generative Models via Finite-Difference Score Matching
HTML
PDF
Tianyu Pang, Kun Xu, Chongxuan Li, Yang Song, Stefano Ermon...
TL;DR
通过使用有限差分法(FD)对一些机器学习应用中的高阶导数进行近似计算,例如生成模型中的SM(Score Matching),可以大大降低计算成本,并提高数值稳定性。
Abstract
Several
machine learning
applications involve the optimization of
higher-order derivatives
(e.g., gradients of gradients) during training, which can be expensive in respect to memory and computation even with aut
→