An inexact regularized proximal Newton method for nonconvex and nonsmooth optimization
Ruyu Liu,Shaohua Pan,Yuqia Wu,Xiaoqi Yang
DOI: https://doi.org/10.1007/s10589-024-00560-0
2024-02-21
Computational Optimization and Applications
Abstract:This paper focuses on the minimization of a sum of a twice continuously differentiable function f and a nonsmooth convex function. An inexact regularized proximal Newton method is proposed by an approximation to the Hessian of f involving the th power of the KKT residual. For , we justify the global convergence of the iterate sequence for the KL objective function and its R-linear convergence rate for the KL objective function of exponent 1/2. For , by assuming that cluster points satisfy a locally Hölderian error bound of order q on a second-order stationary point set and a local error bound of order on the common stationary point set, respectively, we establish the global convergence of the iterate sequence and its superlinear convergence rate with order depending on q and . A dual semismooth Newton augmented Lagrangian method is also developed for seeking an inexact minimizer of subproblems. Numerical comparisons with two state-of-the-art methods on -regularized Student's t -regressions, group penalized Student's t -regressions, and nonconvex image restoration confirm the efficiency of the proposed method.
mathematics, applied,operations research & management science