Abstract:Mathematical programs with vanishing constraints (MPVCs) are a class of nonlinear optimization problems with applications to various engineering problems such as truss topology design and robot motion planning. MPVCs are difficult problems from both a theoretical and numerical perspective: the combinatorial nature of the vanishing constraints often prevents standard constraint qualifications and optimality conditions from being attained; moreover, the feasible set is inherently nonconvex, and often has no interior around points of interest. In this paper, we therefore study and compare four regularization methods for the numerical solution of MPVCS. Each method depends on a single regularization parameter, which is used to embed the original MPVC into a sequence of standard nonlinear programs. Convergence results for these methods based on both exact and approximate stationary of the subproblems are established under weak assumptions. The improved regularity of the subproblems is studied by providing sufficient conditions for the existence of KKT multipliers. Numerical experiments, based on applications in truss topology design and an optimal control problem from aerothermodynamics, complement the theoretical analysis and comparison of the regularization methods. The computational results highlight the benefit of using regularization over applying a standard solver directly, and they allow us to identify two promising regularization schemes.

Multi-parameter Tikhonov Regularization with the ℓ 0 Sparsity Constraint

Multi-parameter Tikhonov regularization with the ` sparsity constraint: ` convergence

Tikhonov Regularization with L^0-Term Complementing a Convex Penalty: L^1 Convergence under Sparsity Constraints

Multi-parameter Regularization and Its Numerical Realization

Sparse Reconstruction by Means of the Standard Tikhonov Regularization

Sparsity reconstruction by the standard Tikhonov method

Linear Convergence of Inexact Descent Method and Inexact Proximal Gradient Algorithms for Lower-Order Regularization Problems

Sparse Estimation Via Lower-Order Penalty Optimization Methods in High-Dimensional Linear Regression.

Discrepancy Curves for Multi-Parameter Regularization

A Stable Multi-parameter Thresholding Method for Ill-conditioned Sparse Signal Restoration and Optimal Parameter Choices.

An iteration regularization method with general convex penalty for nonlinear inverse problems in Banach spaces

Dual Regularized Total Least Squares and Multi-Parameter Regularization

On the Generalized Discrepancy Principle for Tikhonov Regularization in Hilbert Scales

Sparse Parameter Identification for Stochastic Systems Based on [math] Regularization

On the Conditions of Sparse Parameter Estimation via Log-Sum Penalty Regularization.

Characterizing the SLOPE Trade-off: A Variational Perspective and the Donoho-Tanner Limit

A Study of One-Parameter Regularization Methods for Mathematical Programs with Vanishing Constraints

An Analysis of Tikhonov Regularization for Nonlinear Ill-Posed Problems under a General Smoothness Assumption

Group sparse optimization via l

Reduced-Space Iteratively Reweighted Second-Order Methods for Nonconvex Sparse Regularization

High-dimensional Inference Via Lipschitz Sparsity-Yielding Regularizers.