Abstract:We consider the following problem in computational geometry: given, in the d-dimensional real space, a set of points marked as positive and a set of points marked as negative, such that the convex hull of the positive set does not intersect the negative set, find K hyperplanes that separate, if possible, all the positive points from the negative ones. That is, we search for a convex polyhedron with at most K faces, containing all the positive points and no negative point. The problem is known in the literature for pure convex polyhedral approximation; our interest stems from its possible applications in constraint learning, where points are feasible or infeasible solutions of a Mixed Integer Program, and the K hyperplanes are linear constraints to be found. We cast the problem as an optimization one, minimizing the number of negative points inside the convex polyhedron, whenever exact separation cannot be achieved. We introduce models inspired by support vector machines and we design two mathematical programming formulations with binary variables. We exploit Dantzig-Wolfe decomposition to obtain extended formulations, and we devise column generation algorithms with ad-hoc pricing routines. We compare computing time and separation error values obtained by all our approaches on synthetic datasets, with number of points from hundreds up to a few thousands, showing our approaches to perform better than existing ones from the literature. Furthermore, we observe that key computational differences arise, depending on whether the budget K is sufficient to completely separate the positive points from the negative ones or not. On 8-dimensional instances (and over), existing convex hull algorithms become computational inapplicable, while our algorithms allow to identify good convex hull approximations in minutes of computation.

The Hill Detouring Method for Minimizing Hinging Hyperplanes Functions.

A Modified Hill Detouring Algorithm For Hinging Hyperplanes Minimization

Method of hill tunneling via simplex centroid for continuous piecewise linear programming

Hill Tunneling Method Via Peak Subpoints for Continuous Piecewise Linear Programming

Efficient Algorithm for Solving Hyperbolic Programs

Generalization of hinging hyperplanes

Optimization over convex polyhedra via Hadamard parametrizations

A New Discrete Filled Function Method for Finding Global Minimizer of the Integer Programming

Global optimization of separable objective functions on convex polyhedra via piecewise-linear approximation

Mathematical Programming Algorithms for Convex Hull Approximation with a Hyperplane Budget

PolyCD: Optimization via Cycling through the Vertices of a Polytope

An Integrated Algorithm for Hinging Hyperplanes and Its Application in Distillation Process

Improving Algorithm of Hinging Hyperplanes for Function Approximation

Local optimality for hinging hyperplanes-based model predictive control

On Convergence of the Gauss-Newton Method for Convex Composite Optimization

Iterative methods for constrained convex minimization problem in Hilbert spaces

Continuous Piecewise Linear Programming Via Concave Optimization and Genetic Algorithm

Convergence depth control for interior point methods

A DECOMPOSITION METHOD FOR CONVEX MINIMIZATION PROBLEMS AND ITS APPLICATION

Simplex QP-based methods for minimizing a conic quadratic objective over polyhedra

Optimization based on adaptive hinging hyperplanes and genetic algorithm.