当前位置: X-MOL 学术Optim. Methods Softw. › 论文详情
Our official English website, www.x-mol.net, welcomes your feedback! (Note: you will need to create a separate account there.)
A concise second-order complexity analysis for unconstrained optimization using high-order regularized models
Optimization Methods & Software ( IF 2.2 ) Pub Date : 2019-10-24 , DOI: 10.1080/10556788.2019.1678033
C. Cartis 1 , N. I. M. Gould 2 , Ph. L. Toint 3
Affiliation  

An adaptive regularization algorithm is proposed that uses Taylor models of the objective of order p, p2, of the unconstrained objective function, and that is guaranteed to find a first- and second-order critical point in at most O(max{ϵ1p+1p,ϵ2p+1p1}) function and derivatives evaluations, where ϵ1 and ϵ2 are prescribed first- and second-order optimality tolerances. This is a simple algorithm and associated analysis compared to the much more general approach in Cartis et al. [Sharp worst-case evaluation complexity bounds for arbitrary-order nonconvex optimization with inexpensive constraints, arXiv:1811.01220, 2018] that addresses the complexity of criticality higher-than two; here, we use standard optimality conditions and practical subproblem solves to show a same-order sharp complexity bound for second-order criticality. Our approach also extends the method in Birgin et al. [Worst-case evaluation complexity for unconstrained nonlinear optimization using high-order regularized models, Math. Prog. A 163(1) (2017), pp. 359–368] to finding second-order critical points, under the same problem smoothness assumptions as were needed for first-order complexity.



中文翻译:

使用高阶正则化模型进行无约束优化的简洁二阶复杂度分析

提出了一种自适应正则化算法,该算法使用目标p的泰勒模型,p2不受约束的目标函数,并且可以保证最多找到一个一阶和二阶临界点 Ø最高{ϵ1个-p+1个pϵ2-p+1个p-1个} 功能和派生评估,其中 ϵ1个ϵ2规定了一阶和二阶最优容差。与Cartis人中更为通用的方法相比,这是一种简单的算法和相关分析[适用于具有廉价约束的任意阶非凸优化的尖锐最坏情况评估复杂度界限,arXiv:1811.01220,2018年]解决了大于2的临界复杂度;在这里,我们使用标准的最优性条件和实际的子问题来解决,以显示出针对二阶关键性的同阶尖锐复杂性。我们的方法还扩展了Birgin等人的方法[使用高阶正则化模型进行无约束非线性优化的最坏情况评估复杂度, 数学。编 163(1)(2017),第359–368页],在与一阶复杂度相同的问题平滑度假设下,找到二阶临界点。

更新日期:2020-04-23
down
wechat
bug