Abstract:In many real-world applications, it is prohibitively expensive to drastically change the solution to a problem after a small perturbation in the environment. Therefore, the stability of an algorithm is a very desirable property. In this paper, we study the class of pointwise Lipschitz continuous algorithms as introduced in the recent work of Kumabe and Yoshida [FOCS'23]. The Lipschitz constant of an algorithm, intuitively, bounds the ratio of the changes in its output (measured in $\ell_1$ distance) over the $\ell_1$ perturbations of the weights of the underlying graph. In this work, we give a general and simple framework for bounding the Lipschitz constant of algorithms measured through the unweighted $\ell_1$ distance of their outputs. Our approach consists of three main steps. First, we consider a natural continuous relaxation of the underlying graph problem by adding a smooth and strongly convex regularizer to the objective function. Then, we give upper bounds on the $\ell_1$ distance of the optimal solutions of the convex programs, under small perturbations of the weights, via a stability analysis of the trajectory of the proximal gradient method. Finally, we present new problem-specific rounding techniques to obtain integral solutions to several graph problems that approximately maintain the stability guarantees of the fractional solutions. We apply our framework to a number of problems including minimum $s$-$t$ cut, densest subgraph, maximum $b$-matching, and packing integer programs. To complement our algorithms, we show the tightness of our results for certain problems by establishing tight lower bounds.

Continuous Relaxation of Discontinuous Shrinkage Operator: Proximal Inclusion and Conversion

A Full-Invariant Theorem and Some Applications

Continuous Exact Relaxation and Alternating Proximal Gradient Algorithm for Partial Sparse and Partial Group Sparse Optimization Problems

Pointwise Lipschitz Continuous Graph Algorithms via Proximal Gradient Analysis

On the optimal linear convergence factor of the relaxed proximal point algorithm for monotone inclusion problems.

Convergence analysis of inexact proximal point algorithms on Hadamard manifolds

A UNIFIED AND TIGHT LINEAR CONVERGENCE ANALYSIS OF THE RELAXED PROXIMAL POINT ALGORITHM

Convergence rate of inexact proximal point algorithms for operator with holder metric subregularity

Proximal Point Algorithms on Hadamard Manifolds: Linear Convergence and Finite Termination

Lower semicontinuity and relaxation of nonlocal $L^\infty$-functionals

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Exact continuous relaxations of l0-regularized criteria with non-quadratic data terms

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Monotone vector fields and the proximal point algorithm on Hadamard manifolds

Continuous operators from spaces of Lipschitz functions

Lifting the Convex Conjugate in Lagrangian Relaxations: A Tractable Approach for Continuous Markov Random Fields

Extracting structure from functional expressions for continuous and discrete relaxations of MINLP

Lax Equivalence for Hyperbolic Relaxation Approximations

Resolvent and Proximal Compositions

On relaxed inertial projection and contraction algorithms for solving monotone inclusion problems

Exact Lipschitz Regularization of Convex Optimization Problems