Abstract:<h3 class="a-plus-plus">Abstract</h3> <p class="a-plus-plus">Uniformly optimal convex programming algorithms have been designed to achieve the optimal complexity bounds for convex optimization problems regardless of the level of smoothness of the objective function. In this paper, we present a generic framework to extend such existing algorithms to solve more general nonlinear, possibly nonconvex, optimization problems. The basic idea is to incorporate a local search step (gradient descent or Quasi-Newton iteration) into the uniformly optimal convex programming methods, and then enforce a monotone decreasing property of the function values computed along the trajectory. While optimal methods for nonconvex programming are not generally known, algorithms of these types will achieve the best known complexity for nonconvex problems, and the optimal complexity for convex ones without requiring any problem parameters. As a consequence, we can have a unified treatment for a general class of nonlinear programming problems regardless of their convexity and smoothness level. In particular, we show that the accelerated gradient and level methods, both originally designed for solving convex optimization problems only, can be used for solving both convex and nonconvex problems uniformly. In a similar vein, we show that some well-studied techniques for nonlinear programming, e.g., Quasi-Newton iteration, can be embedded into optimal convex optimization algorithms to possibly further enhance their numerical performance. Our theoretical and algorithmic developments are complemented by some promising numerical results obtained for solving a few important nonconvex and nonlinear data analysis problems in the literature.</p>

Generalized Nonlinear Lagrangian Formulation for Bounded Integer Programming

A Nonlinear Lagrangian Dual For Integer Programming

New Dual Formulations In Constrained Integer Programming

Asymptotic Strong Duality for Bounded Integer Programming: A Logarithmic-Exponential Dual Formulation

Logarithmic-Exponential Dual Formulation For Integer Programming

Towards Strong Duality in Integer Programming

Constraint Qualifications for Optimality Conditions and Total Lagrange Dualities in Convex Infinite Programming

Convergent Lagrangian and Contour Cut Method for Nonlinear Integer Programming with a Quadratic Objective Function

Computing Exact Solution to Nonlinear Integer Programming: Convergent Lagrangian and Objective Level Cut Method.

On generalized surrogate duality in mixed-integer nonlinear programming

Convex Relaxation and Lagrangian Decomposition for Indefinite Integer Quadratic Programming

Implicit augmented Lagrangian and generalized optimization

Asymptotic Strong Determination in Integer Programming: Quasi Dual Method

Compact mixed-integer programming formulations in quadratic optimization

Constraint Qualifications for Extended Farkas'S Lemmas and Lagrangian Dualities in Convex Infinite Programming

An efficient algorithm for nonlinear integer programming problems arising in series–parallel reliability systems

Developing Lagrangian-based Methods for Nonsmooth Nonconvex Optimization

On Squared-Variable Formulations

Optimality Conditions and Duality for a Class of Nonlinear Fractional Programming Problems

Global solutions of nonconvex standard quadratic programs via mixed integer linear programming reformulations

Generalized Uniformly Optimal Methods for Nonlinear Programming