Abstract:Binary optimization is a central problem in mathematical optimization and its applications are abundant. To solve this problem, we propose a new class of continuous optimization techniques which is based on Mathematical Programming with Equilibrium Constraints (MPECs). We first reformulate the binary program as an equivalent augmented biconvex optimization problem with a bilinear equality constraint, then we propose two penalization/regularization methods (exact penalty and alternating direction) to solve it. The resulting algorithms seek desirable solutions to the original problem via solving a sequence of linear programming convex relaxation subproblems. In addition, we prove that both the penalty function and augmented Lagrangian function, induced by adding the complementarity constraint to the objectives, are exact, i.e., they have the same local and global minima with those of the original binary program when the penalty parameter is over some threshold. The convergence of both algorithms can be guaranteed, since they essentially reduce to block coordinate descent in the literature. Finally, we demonstrate the effectiveness and versatility of our methods on several important problems, including graph bisection, constrained image segmentation, dense subgraph discovery, modularity clustering and Markov random fields. Extensive experiments show that our methods outperform existing popular techniques, such as iterative hard thresholding, linear programming relaxation and semidefinite programming relaxation.

A Generalized Project Metric Algorithm for Mathematical Programs with Equilibrium Constraints

Smoothing Partial Exact Penalty Splitting Method for Mathematical Programs with Equilibrium Constraints

On some optimality conditions for a class of problems in mathematical programming with equilibrium constraints

Binary Optimization via Mathematical Programming with Equilibrium Constraints

Approximation Methods for a Class of Non-Lipschitz Mathematical Programs with Equilibrium Constraints

Second-Order Optimality Conditions for Mathematical Programs with Equilibrium Constraints

Mathematical Programs with Multiobjective Generalized Nash Equilibrium Problems in the Constraints

Solving Mathematical Programs with Equilibrium Constraints

A Sequential Smooth Penalization Approach to Mathematical Programs with Complementarity Constraints

Mathematical Programs with Geometric Constraints in Banach Spaces: Enhanced Optimality, Exact Penalty, and Sensitivity

Wolfe-Type Duality for Mathematical Programs with Equilibrium Constraints

Notes on Some Constraint Qualifications for Mathematical Programs with Equilibrium Constraints

Globally Convergent Algorithm for Solving Stationary Points for Mathematical Programs with Complementarity Constraints Via Nonsmooth Reformulations

A New Augmented Lagrangian Method for MPCCs - Theoretical and Numerical Comparison with Existing Augmented Lagrangian Methods

Convergence Properties of Modified and Partially-Augmented Lagrangian Methods for Mathematical Programs with Complementarity Constraints

Sensitivity Analysis of the Value Function for Parametric Mathematical Programs with Equilibrium Constraints.

Mathematical Programs with Complementarity Constraints and a Non-Lipschitz Objective: Optimality and Approximation.

Hybrid Projection Algorithms for Generalized Equilibrium Problems and Strictly Pseudocontractive Mappings

Stability Analysis for Parametric Mathematical Programs with Geometric Constraints and Its Applications.

Variable Metric Method for Unconstrained Multiobjective Optimization Problems

Strong Convergence of an Iterative Method for Solving Generalized Mixed Equilibrium Problems and Split Feasibility Problems