BriefGPT.xyz
Feb, 2020
自动微分在最小值函数中的超高效性
Super-efficiency of automatic differentiation for functions defined as a minimum
HTML
PDF
Pierre Ablin, Gabriel Peyré, Thomas Moreau
TL;DR
本文研究了用于最小化函数的梯度估计方法的渐近误差,并找到了自动估计器误差接近于解析估计器误差平方的超高效现象,分析了这些估计器的收敛率和计算复杂度,并给出了实际指南以在它们之间进行选择。
Abstract
In
min-min optimization
or
max-min optimization
, one has to compute the gradient of a function defined as a minimum. In most cases, the minimum has no closed-form, and an approximation is obtained via an iterativ
→