Abstract:In this paper we obtain a verifiable sufficient condition for a polyhedral multifunction to be Lipschitz continuous on its domain. We apply this sufficient condition to establish the Lipschitz continuity of the solution multifunction for an extended $\ell_1$ regularization problem with respect to the regularization parameter and the observation parameter under the assumption that the data matrix is of full row rank. In doing so, we show that the solution multifunction is a polyhedral one by expressing its graph as the union of the polyhedral cones constructed by the index sets defined by nonempty faces of the feasible set of an extended dual $\ell_1$ regularization problem. We demonstrate that the domain of the solution multifunction is partitioned as the union of the projections of the above polyhedral cones onto the parameters space and that the graph of the restriction of the multifunction on each of these projections is convex. In comparing with the existing result of the local Lipschitz continuity of the Lasso problem in the literature where certain linear independence condition was assumed, our condition (i.e., full row rank of data matrix) is very weak and our result (i.e., Lipschitz continuity on the domain) is much more stronger. As corollaries of the Lipschitz continuity of the solution multifunction, we show that the single-valuedness and linearity (or piecewise linearity) of the solution multifunction on a particular polyhedral set of the domain are equivalent to certain linear independence conditions of the corresponding columns of the data matrix proposed in the literature.

Exact Lipschitz Regularization of Convex Optimization Problems

On Convergence Rates of Linearized Proximal Algorithms for Convex Composite Optimization with Applications.

Majorizing Functions and Convergence of the Gauss-Newton Method for Convex Composite Optimization

Gauss–Newton Method for Convex Composite Optimizations on Riemannian Manifolds

Decomposition Method for Lipschitz Stability of General LASSO-type Problems

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Lipschitz stability of least-squares problems regularized by functions with $\mathcal{C}^2$-cone reducible conjugates

Convergence Analysis of the Gauss–Newton-Type Method for Lipschitz-Like Mappings

First Order Methods beyond Convexity and Lipschitz Gradient Continuity with Applications to Quadratic Inverse Problems

On compositions of special cases of Lipschitz continuous operators

Adaptive Algorithms for Relatively Lipschitz Continuous Convex Optimization Problems

Exact continuous relaxations of l0-regularized criteria with non-quadratic data terms

Lipschitz regularity of a weakly coupled vectorial almost-minimizers for the $p$-Laplacian

Error Bounds for Non-Polyhedral Convex Optimization and Applications to Linear Convergence of FDM and PGM.

Norm-induced Cuts: Optimization with Lipschitzian Black-box Functions

Relaxed Viscosity Approximation Methods with Regularization for Constrained Minimization Problems

Lipschitz minimization and the Goldstein modulus

Lipschitz continuity of solution multifunctions of extended $\ell_1$ regularization problems

A General Non-Lipschitz Infimal Convolution Regularized Model: Lower Bound Theory and Algorithm

Tikhonov Regularization for Stochastic Non-Smooth Convex Optimization in Hilbert Spaces

Discrete-to-Continuum Rates of Convergence for $p$-Laplacian Regularization