Abstract:High-order tensor methods for solving both convex and nonconvex optimization problems have generated significant research interest, leading to algorithms with optimal global rates of convergence and local rates that are faster than Newton's method. On each iteration, these methods require the unconstrained local minimization of a (potentially nonconvex) multivariate polynomial of degree higher than two, constructed using third-order (or higher) derivative information, and regularized by an appropriate power of regularization. Developing efficient techniques for solving such subproblems is an ongoing topic of research, and this paper addresses the case of the third-order tensor subproblem. We propose the CQR algorithmic framework, for minimizing a nonconvex Cubic multivariate polynomial with Quartic Regularisation, by minimizing a sequence of local quadratic models that incorporate simple cubic and quartic terms. The role of the cubic term is to crudely approximate local tensor information, while the quartic one controls model regularization and progress. We provide necessary and sufficient optimality conditions that fully characterise the global minimizers of these cubic-quartic models. We then turn these conditions into secular equations that can be solved using nonlinear eigenvalue techniques. We show, using our optimality characterisations, that a CQR algorithmic variant has the optimal-order evaluation complexity of $\mathcal{O}(\epsilon^{-3/2})$ when applied to minimizing our quartically-regularised cubic subproblem, which can be further improved in special cases. We propose practical CQR variants that use local tensor information to construct the local cubic-quartic models. We test these variants numerically and observe them to be competitive with ARC and other subproblem solvers on typical instances and even superior on ill-conditioned subproblems with special structure.

The distance to cubic symmetry class as a polynomial optimization problem

Distance to a constitutive tensor isotropy stratum by Lasserre polynomial optimization method

2D and 3D cubic monocrystalline and polycrystalline materials: their stability and mechanical properties

Symmetry & Critical Points for Symmetric Tensor Decomposition Problems

Invariant-based approach to symmetry class detection

On the Geometric Analysis of a Quartic–quadratic Optimization Problem under a Spherical Constraint

On the best choice of symmetry group for group-theoretic computational schemes in solid and structural mechanics

Symmetry Based Material Optimization

Cubic-quartic regularization models for solving polynomial subproblems in third-order tensor methods

On symmetry adapted bases in trigonometric optimization

Cubic Single Crystal Representations in Classical and Size-dependent Couple Stress Elasticity

Stochastic Modelling of Elasticity Tensors

A miscellanea of qualitative and symmetry properties of the solutions to the two-phase Serrin's problem

Optimization of trigonometric polynomials with crystallographic symmetry and spectral bounds for set avoiding graphs

Determination of the symmetries of an experimentally determined stiffness tensor; application to acoustic measurements

Copositivity criteria of a class of fourth order 3-dimensional symmetric tensors

Efficient Spectral Methods for Quasi-Equilibrium Closure Approximations of Symmetric Problems on Unit Circle and Sphere

Exploitation of symmetry in graphs with applications to finite and boundary elements analysis

Relations Between Cubic Equation, Stress Tensor Decomposition, and Von Mises Yield Criterion

Optimal orientation of anisotropic solids

Ab-initio elastic tensor of cubic Ti$_{0.5}$Al$_{0.5}$N alloy: the dependence of the elastic constants on the size and shape of the supercell model