Abstract:Binary optimization is a central problem in mathematical optimization and its applications are abundant. To solve this problem, we propose a new class of continuous optimization techniques which is based on Mathematical Programming with Equilibrium Constraints (MPECs). We first reformulate the binary program as an equivalent augmented biconvex optimization problem with a bilinear equality constraint, then we propose two penalization/regularization methods (exact penalty and alternating direction) to solve it. The resulting algorithms seek desirable solutions to the original problem via solving a sequence of linear programming convex relaxation subproblems. In addition, we prove that both the penalty function and augmented Lagrangian function, induced by adding the complementarity constraint to the objectives, are exact, i.e., they have the same local and global minima with those of the original binary program when the penalty parameter is over some threshold. The convergence of both algorithms can be guaranteed, since they essentially reduce to block coordinate descent in the literature. Finally, we demonstrate the effectiveness and versatility of our methods on several important problems, including graph bisection, constrained image segmentation, dense subgraph discovery, modularity clustering and Markov random fields. Extensive experiments show that our methods outperform existing popular techniques, such as iterative hard thresholding, linear programming relaxation and semidefinite programming relaxation.

On some optimality conditions for a class of problems in mathematical programming with equilibrium constraints

Second-Order Optimality Conditions for Mathematical Programs with Equilibrium Constraints

Notes on Some Constraint Qualifications for Mathematical Programs with Equilibrium Constraints

Further Investigation on Feasibility of Mathematical Programs with Equilibrium Constraints

A new smoothing technique for mathematical programs with equilibrium constraints

Partial Exact Penalty for Mathematical Programs with Equilibrium Constraints

Binary Optimization via Mathematical Programming with Equilibrium Constraints

Necessary Optimality Conditions for Optimal Control Problems with Equilibrium Constraints

Solving Mathematical Programs with Equilibrium Constraints

Approximation Methods for a Class of Non-Lipschitz Mathematical Programs with Equilibrium Constraints

A Conjugate Gradient Projection Algorithm for Mathematical Programs with Equilibrium Constraints

Optimality conditions and duality for mathematical programming with equilibrium constraints including multiple interval-valued objective functions on Hadamard manifolds

On the Second Order Sufficient Optimality Conditions for a Problem of Mathematical Programming

A Generalized Project Metric Algorithm for Mathematical Programs with Equilibrium Constraints

Mathematical Programs with Geometric Constraints in Banach Spaces: Enhanced Optimality, Exact Penalty, and Sensitivity

Sensitivity Analysis of the Value Function for Parametric Mathematical Programs with Equilibrium Constraints.

Smoothing Partial Exact Penalty Splitting Method for Mathematical Programs with Equilibrium Constraints

New Necessary Optimality Conditions for Bilevel Programs by Combining the MPEC and Value Function Approaches

Mathematical Programs with Complementarity Constraints and a Non-Lipschitz Objective: Optimality and Approximation.

Wolfe-Type Duality for Mathematical Programs with Equilibrium Constraints

First Order Necessary Optimality Conditions for Mathematical Programs with Second-Order Cone Complementarity Constraints