Abstract:We provide an interior point method based on quasi-Newton iterations, which only requires first-order access to a strongly self-concordant barrier function. To achieve this, we extend the techniques of Dunagan-Harvey [STOC '07] to maintain a preconditioner, while using only first-order information. We measure the quality of this preconditioner in terms of its relative excentricity to the unknown Hessian matrix, and we generalize these techniques to convex functions with a slowly-changing Hessian. We combine this with an interior point method to show that, given first-order access to an appropriate barrier function for a convex set $K$, we can solve well-conditioned linear optimization problems over $K$ to $\varepsilon$ precision in time $\widetilde{O}\left(\left(\mathcal{T}+n^{2}\right)\sqrt{n\nu}\log\left(1/\varepsilon\right)\right)$, where $\nu$ is the self-concordance parameter of the barrier function, and $\mathcal{T}$ is the time required to make a gradient query. As a consequence we show that: $\bullet$ Linear optimization over $n$-dimensional convex sets can be solved in time $\widetilde{O}\left(\left(\mathcal{T}n+n^{3}\right)\log\left(1/\varepsilon\right)\right)$. This parallels the running time achieved by state of the art algorithms for cutting plane methods, when replacing separation oracles with first-order oracles for an appropriate barrier function. $\bullet$ We can solve semidefinite programs involving $m\geq n$ matrices in $\mathbb{R}^{n\times n}$ in time $\widetilde{O}\left(mn^{4}+m^{1.25}n^{3.5}\log\left(1/\varepsilon\right)\right)$, improving over the state of the art algorithms, in the case where $m=\Omega\left(n^{\frac{3.5}{\omega-1.25}}\right)$. Along the way we develop a host of tools allowing us to control the evolution of our potential functions, using techniques from matrix analysis and Schur convexity.

A logarithmic barrier interior-point method based on majorant functions for second-order cone programming

An Efficient Interior-Point Algorithm with New Non-Monotone Line Search Filter Method for Nonlinear Constrained Programming

A Quadratically Convergent Sequential Programming Method for Second-Order Cone Programs Capable of Warm Starts

Log-domain interior-point methods for convex quadratic programming

Interior Point Method with Modified Augmented Lagrangian for Penalty-Barrier Nonlinear Programming

Monomial barrier functions for the box-constrained convex optimization problems

A structured modified Newton approach for solving systems of nonlinear equations arising in interior-point methods for quadratic programming

A New Iteration Large-Update Primal-Dual Interior-Point Method for Second-Order Cone Programming

Extended Newton Methods for Multiobjective Optimization: Majorizing Function Technique and Convergence Analysis

A primal-dual interior-point relaxation method for nonlinear programs

A Newton-CG based barrier-augmented Lagrangian method for general nonconvex conic optimization

A generalized direction in interior point method for monotone linear complementarity problems

A second order affine scaling algorithm for the geometric programming dual with logarithmic barrier

On the Convergence of Interior-Point Methods for Bound-Constrained Nonlinear Optimization Problems with Noise

Conversion of some classes of fractional programming to second-order cone programming and solving it by potential reduction interior point method

A primal-dual interior-point relaxation method with global and rapidly local convergence for nonlinear programs

A Unified Convergence Analysis of a Second-Order Method of Multipliers for Nonlinear Conic Programming

A Primal Majorized Semismooth Newton-CG Augmented Lagrangian Method for Large-Scale Linearly Constrained Convex Programming

Interior Point Methods with a Gradient Oracle

Polynomial Complexity of an Interior Point Algorithm with a Second Order Corrector Step for Symmetric Cone Programming.