Abstract:<h3 class="a-plus-plus">Abstract</h3> <p class="a-plus-plus">Uniformly optimal convex programming algorithms have been designed to achieve the optimal complexity bounds for convex optimization problems regardless of the level of smoothness of the objective function. In this paper, we present a generic framework to extend such existing algorithms to solve more general nonlinear, possibly nonconvex, optimization problems. The basic idea is to incorporate a local search step (gradient descent or Quasi-Newton iteration) into the uniformly optimal convex programming methods, and then enforce a monotone decreasing property of the function values computed along the trajectory. While optimal methods for nonconvex programming are not generally known, algorithms of these types will achieve the best known complexity for nonconvex problems, and the optimal complexity for convex ones without requiring any problem parameters. As a consequence, we can have a unified treatment for a general class of nonlinear programming problems regardless of their convexity and smoothness level. In particular, we show that the accelerated gradient and level methods, both originally designed for solving convex optimization problems only, can be used for solving both convex and nonconvex problems uniformly. In a similar vein, we show that some well-studied techniques for nonlinear programming, e.g., Quasi-Newton iteration, can be embedded into optimal convex optimization algorithms to possibly further enhance their numerical performance. Our theoretical and algorithmic developments are complemented by some promising numerical results obtained for solving a few important nonconvex and nonlinear data analysis problems in the literature.</p>

Nonlinear Programming Solvers for Unconstrained and Constrained Optimization Problems: a Benchmark Analysis

Comparative Analysis of Nonlinear Programming Solvers: Performance Evaluation, Benchmarking, and Multi-UAV Optimal Path Planning

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

Numerical comparison of nonlinear programming algorithms for structural optimization

Unifying nonlinearly constrained nonconvex optimization

CSOLNP: Numerical Optimization Engine for Solving Non-linearly Constrained Problems

Design and Implementation of Large-scale Nonlinear Optimization Software UniOptima

NonlinearSolve.jl: High-Performance and Robust Solvers for Systems of Nonlinear Equations in Julia

Random sampling-based automatic parameter tuning for nonlinear programming solvers

Barrier NLP Methods with Structured Regularization for Optimization of Degenerate Optimization Problems

23 European Symposium on Computer Aided Process Engineering: A Parallel Method with Hybrid Algorithms for Mixed Integer Nonlinear Programming

A Parallel Method With Hybrid Algorithms For Mixed Integer Nonlinear Programming

A Comparison of Nonsmooth, Nonconvex, Constrained Optimization Solvers for the Design of Time-Delay Compensators

Structured Regularization In Barrier Nlp For Optimization Models With Dependent Constraints

A learning-based mathematical programming formulation for the automatic configuration of optimization solvers

Solving continuous and discrete nonlinear programs with BARON

Nonlinear Equations Solving with Intelligent Optimization Algorithms: A Survey.

A Test-Suite of Non-Convex Constrained Optimization Problems from the Real-World and Some Baseline Results

Generalized Uniformly Optimal Methods for Nonlinear Programming

A computational study of off-the-shelf MINLP solvers on a benchmark set of congested capacitated facility location problems

Iterative Methods in GPU-Resident Linear Solvers for Nonlinear Constrained Optimization