Abstract:In the first part of this paper, we prove that, under some natural non-degeneracy assumptions, the Greedy Parabolic Target-Following Method, based on {\em universal tangent direction} has a favorable local behavior. In view of its global complexity bound of the order $O(\sqrt{n} \ln {1 \over \epsilon})$, this fact proves that the functional proximity measure, used for controlling the closeness to Greedy Central Path, is large enough for ensuring a local super-linear rate of convergence, provided that the proximity to the path is gradually reduced. This requirement is eliminated in our second algorithm based on a new auto-correcting predictor direction. This method, besides the best-known polynomial-time complexity bound, ensures an automatic switching onto the local quadratic convergence in a small neighborhood of solution. Our third algorithm approximates the path by quadratic curves. On the top of the best-known global complexity bound, this method benefits from an unusual local cubic rate of convergence. This amelioration needs no serious increase in the cost of one iteration. We compare the advantages of these local accelerations with possibilities of finite termination. The conditions allowing the optimal basis detection sometimes are even weaker than those required for the local superlinear convergence. Hence, it is important to endow the practical optimization schemes with both abilities. The proposed methods have a very interesting combination of favorable properties, which can be hardly found in the most of existing Interior-Point schemes. As all other parabolic target-following schemes, the new methods can start from an arbitrary strictly feasible primal-dual pair and go directly towards the optimal solution of the problem in a single phase. The preliminary computational experiments confirm the advantage of the second-order prediction.

What problem does this paper attempt to address?

This paper attempts to solve the problems of local and global convergence of interior - point methods (IPMs) in linear programming (LP). Specifically, the author Yurii Nesterov explores improved algorithms based on the Greedy Parabolic Target - Following Method in the paper and proves the local and global convergence properties of these algorithms. ### Main Research Problems 1. **Local Convergence**: - The author first proves that under certain natural non - degeneracy assumptions, the Greedy Parabolic Target - Following Method based on the Universal Tangent Direction has good local behavior. - Specifically, when approaching the Greedy Central Path, the Functional Proximity Measure (FPM) is large enough to ensure a local super - linear rate of convergence, provided that the proximity of the path is gradually reduced. 2. **Global Complexity Bound**: - The method proposed in the paper has the best - known global complexity bound $O(\sqrt{n}\ln\frac{1}{\epsilon})$, where $n$ is the dimension of the problem and $\epsilon$ is the required precision of the solution. 3. **Improved Self - Correcting Prediction Direction**: - The second algorithm introduces a new self - correcting prediction direction, which not only maintains the best - known polynomial - time complexity bound but also can automatically switch to local quadratic convergence within a small neighborhood of the solution. 4. **Quadratic Curve Approximation Path**: - The third algorithm approximates the path by a quadratic curve. Besides maintaining the best global complexity bound, it also benefits from an unusual local cubic rate of convergence. Importantly, this improvement does not require a significant increase in the cost per iteration. 5. **Finite Termination Conditions**: - The author also proposes three new and easy - to - calculate indicators to achieve finite termination for all methods, and these conditions are sometimes weaker than those required for local super - linear convergence. ### Research Background Since the 1980s, the pioneering work of Karmarkar, Renegar, and Gonzaga has made interior - point methods one of the most active research directions in linear programming. Although interior - point methods have excellent worst - case polynomial - time complexity bounds, in practical applications, first - order methods are more popular because newly emerging machine - learning and artificial - intelligence problems usually have high dimensions and special structures. However, although first - order methods have low computational costs, they have slow convergence speeds and lack polynomial - time complexity bounds. Therefore, how to improve interior - point methods to adapt to new practical requirements and obtain more efficient optimization schemes has become an important research topic. ### Conclusion The several new methods proposed in this paper combine favorable properties that are difficult to find in most existing interior - point method schemes. In particular, these methods can move directly from any strictly feasible initial point to the optimal solution without going through multiple stages of the minimization process. Preliminary computational experiments also confirm the advantages of second - order prediction.

Local and Global Convergence of Greedy Parabolic Target-Following Methods for Linear Programming

Improved Sequential Convex Programming Based on Pseudospectral Discretization for Entry Trajectory Optimization

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Linearized Proximal Algorithms with Adaptive Stepsizes for Convex Composite Optimization with Applications

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Improved global performance guarantees of second-order methods in convex minimization

Convergence of successive linear programming algorithms for noisy functions

A Proximal-Gradient Method for Constrained Optimization

A primal-dual interior-point relaxation method with global and rapidly local convergence for nonlinear programs

Superlinear convergence of an interior point algorithm on linear semi-definite feasibility problems

Accelerated Bregman Proximal Gradient Methods for Relatively Smooth Convex Optimization

Advances in Nonmonotone Proximal Gradient Methods merely with Local Lipschitz Assumptions in the Presense of Kurdyka-Łojasiewicz Property: A Study of Average and Max Line Search

Accelerated gradient methods for nonconvex optimization: Escape trajectories from strict saddle points and convergence to local minima

Adaptive proximal algorithms for convex optimization under local Lipschitz continuity of the gradient

Geometry-dependent matching pursuit: a transition phase for convergence on linear regression and LASSO

New nonasymptotic convergence rates of stochastic proximal pointalgorithm for convex optimization problems

Variational Analysis Perspective on Linear Convergence of Some First Order Methods for Nonsmooth Convex Optimization Problems

Convergence and Trade-Offs in Riemannian Gradient Descent and Riemannian Proximal Point

Universal Birkhoff Theory for Fast Trajectory Optimization

Generalized Optimistic Methods for Convex-Concave Saddle Point Problems

Parametrization and convergence of a primal-dual block-coordinate approach to linearly-constrained nonsmooth optimization