Abstract:Discrete optimization is a central problem in mathematical optimization with a broad range of applications, among which binary optimization and sparse optimization are two common ones. However, these problems are NP-hard and thus difficult to solve in general. Combinatorial search methods such as branch-and-bound and exhaustive search find the global optimal solution but are confined to small-sized problems, while coordinate descent methods such as coordinate gradient descent are efficient but often suffer from poor local minima. In this paper, we consider a hybrid method that combines the effectiveness of combinatorial search and the efficiency of coordinate descent. Specifically, we consider random strategy or/and greedy strategy to select a subset of coordinates as the working set, and then perform global combinatorial search over the working set based on the original objective function. In addition, we provide some optimality analysis and convergence analysis for the proposed method. Our method finds stronger stationary points than existing methods. Finally, we demonstrate the efficacy of our method on some sparse optimization and binary optimization applications. As a result, our method achieves state-of-the-art performance in terms of accuracy. For example, our method generally outperforms the well-known orthogonal matching pursuit method in sparse optimization. Keywords: Sparsity Optimization, Binary Optimization, Coordinate Descent, Combinatorial Search, Discrete Optimization, Convergence Analysis.

Discrete Optimization Via Simulation Using Coordinate Search

Discrete optimization via simulation: algorithms and error control

Speeding up COMPASS for high-dimensional discrete optimization via simulation

Chapter 2 Discrete Optimization via Simulation

A Hybrid Method of Combinatorial Search and Coordinate Descent for Discrete Optimization

A Framework For Locally Convergent Random-Search Algorithms For Discrete Optimization Via Simulation

Direct Approaches for PDE-constrained Dynamic Optimization Based on Space–time Orthogonal Collocation on Finite Elements

An Adaptive Hyperbox Algorithm for High-Dimensional Discrete Optimization Via Simulation Problems

An adaptive sampling algorithm for simulation-based optimization with descriptive complexity constraints

Adaptive Partitioning Strategy for High-Dimensional Discrete Simulation-based Optimization Problems

Balancing Search and Estimation in Random Search Based Stochastic Simulation Optimization

A Combined Global And Local Search Method To Deal With Constrained Optimization For Continuous Tabu Search

Surrogate-Based Simulation Optimization

Determining the Optimal Sampling Set Size for Random Search

A Brief Introduction to Optimization Via Simulation

Simulation Optimization: A New Approach

Solving a Class of Convex Stochastic Programs Via Monte Carlo Simulation

Optimization Via Simulation Using Gaussian Process-Based Search

Gaussian Mixture Model-Based Random Search for Continuous Optimization Via Simulation

A simulation-based approach for solving optimisation problems with ODE-type steady state constraints

An Adaptive Sampling Algorithm for Simulation-Based Optimization With Descriptive Complexity Preference