BriefGPT.xyz
May, 2017
非凸优化的子采样三次正则化
Sub-sampled Cubic Regularization for Non-convex Optimization
HTML
PDF
Jonas Moritz Kohler, Aurelien Lucchi
TL;DR
本文提出一种基于子采样的方法,以降低cubic regularization方法的高计算复杂度,并利用浓度不等式提出相应的采样方案,从而在保证cubic regularization方法的全局和局部收敛性的同时,给出其全局收敛保证的首个子采样变体在非凸函数的设置中的实验证明。
Abstract
We consider the minimization of non-convex functions that typically arise in
machine learning
. Specifically, we focus our attention on a variant of
trust region methods
known as
→