Abstract:Abstract In this work, we deal with Truncated Newton methods for solving large scale (possibly nonconvex) unconstrained optimization problems. In particular, we consider the use of a modified Bunch and Kaufman factorization for solving the Newton equation, at each (outer) iteration of the method. The Bunch and Kaufman factorization of a tridiagonal matrix is an effective and stable matrix decomposition, which is well exploited in the widely adopted SYMMBK (Bunch and Kaufman in Math Comput 31:163–179, 1977; Chandra in Conjugate gradient methods for partial differential equations, vol 129, 1978; Conn et al. in Trust-region methods. MPS-SIAM series on optimization, Society for Industrial Mathematics, Philadelphia, 2000; HSL, A collection of Fortran codes for large scale scientific computation, http://www.hsl.rl.ac.uk/ ; Marcia in Appl Numer Math 58:449–458, 2008) routine. It can be used to provide conjugate directions, both in the case of $$1\times 1$$ 1 × 1 and $$2\times 2$$ 2 × 2 pivoting steps. The main drawback is that the resulting solution of Newton’s equation might not be gradient–related, in the case the objective function is nonconvex. Here we first focus on some theoretical properties, in order to ensure that at each iteration of the Truncated Newton method, the search direction obtained by using an adapted Bunch and Kaufman factorization is gradient–related. This allows to perform a standard Armijo-type linesearch procedure, using a bounded descent direction. Furthermore, the results of an extended numerical experience using large scale CUTEst problems is reported, showing the reliability and the efficiency of the proposed approach, both on convex and nonconvex problems.

Combined Methods for Solving Degenerate Unconstrained Optimization Problems

A GLOBALLY AND SUPERLIEARLY CONVERGENT FEASIBLE SQP ALGORITHM FOR DEGENERATE CONSTRAINED OPTIMIZATION

Fourth‐order variants of Newton's method without second derivatives for solving non‐linear equations

Super-Universal Regularized Newton Method

Implementable tensor methods in unconstrained convex optimization

A Multilevel Low-Rank Newton Method with Super-linear Convergence Rate and its Application to Non-convex Problems

Fast Multiobjective Gradient Methods with Nesterov Acceleration via Inertial Gradient-Like Systems

New Methods for Parametric Optimization via Differential Equations

Yet another fast variant of Newton’s method for nonconvex optimization

Generalized Newton Method with Positive Definite Regularization for Nonsmooth Optimization Problems with Nonisolated Solutions

Coderivative-Based Newton Methods with Wolfe Linesearch for Nonsmooth Optimization

Improved global performance guarantees of second-order methods in convex minimization

Issues on the use of a modified Bunch and Kaufman decomposition for large scale Newton’s equation

A Unified Convergence Analysis of a Second-Order Method of Multipliers for Nonlinear Conic Programming

Limited-memory common-directions method for large-scale optimization: convergence, parallelization, and distributed optimization

Semi-Smooth Second-order Type Methods for Composite Convex Programs

Convex quartic problems: homogenized gradient method and preconditioning

Higher-Order Corrections to Optimisers based on Newton's Method

A Unifying Framework for Convergence Analysis of Approximate Newton Methods.

Using second-order information in gradient sampling methods for nonsmooth optimization

A Second-Order Finite-Difference Method for Derivative-Free Optimization