Abstract:This paper focuses on the performance evaluation of complex man-made systems, such as assembly lines, electric power grid, traffic systems, and various paper processing bureaucracies, etc. For such problems, applying the traditional optimization tool of mathematical programming and gradient descent procedures of continuous variables optimization are often inappropriate or infeasible, as the design variables are usually discrete and the accurate evaluation of the system performance via a simulation model can take too much calculation. General search type and heuristic methods are the only two methods to tackle the problems. However, the "goodness" of heuristic methods is generally difficult to quantify while search methods often involve extensive evaluation of systems at many design choices in a large search space using a simulation model resulting in an infeasible computation burden. The purpose of this paper is to address these difficulties simultaneously by extending the recently developed methodology of Ordinal Optimization (OO). Uniform samples are taken out from the whole search space and evaluated with a crude but computationally easy model when applying OO. And, we argue, after ordering via the crude performance estimates, that the lined-up uniform samples can be seen as an approximate ruler. By comparing the heuristic design with such a ruler, we can quantify the heuristic design, just as we measure the length of an object with a ruler. In a previous paper we showed how to quantify a heuristic design for a special case but we did not have the OO ruler idea at that time. In this paper we propose the OO ruler idea and extend the quantifying method to the general case and the multiple independent results case. Experimental results of applying the ruler are also given to illustrate the utility of this approach.

Improved Constrained Ordinal Optimization for Simulation-Based Constrained Optimization

Constrained Ordinal Optimization—A Feasibility Model Based Approach

Fundamentals of Ordinal Optimization

An Adaptive Sampling Algorithm for Simulation-Based Optimization With Descriptive Complexity Preference

Accelerated Driving-Training-Based Optimization for Solving Constrained Bi-Objective Stochastic Optimization Problems

Comparison of Selection Rules for Ordinal Optimization

Constrained Bayesian Optimization with Adaptive Active Learning of Unknown Constraints

Approximately Optimal Computing Budget Allocation for Selection of the Best and Worst Designs.

Simulation Budget Allocation for Further Enhancing Theefficiency of Ordinal Optimization

The Equivalence between Ordinal Optimization in Deterministic Complex Problems and in Stochastic Simulation Problems

Vector Ordinal Optimization

Interval Multiobjective Optimization of Structures Based on Radial Basis Function, Interval Analysis, and NSGA-II

Ordinal Optimization and Quantification of Heuristic Designs

An Efficiency and Convergence Analysis of Multi-Fidelity Optimization with Ordinal Transformation and Optimal Sampling.

Constrained Bayesian Optimization Under Partial Observations: Balanced Improvements and Provable Convergence

Relaxed Combinatorial Optimization Networks with Self-Supervision: Theoretical and Empirical Notes on the Cardinality-Constrained Case

Constrained Bayesian optimization with merit functions

Efficient Computing Budget Allocation for Simulation-Based Optimization With Stochastic Simulation Time

Applications of Ordinal Optimization

A novel two-level optimization framework based on constrained ordinal optimization and evolutionary algorithms for scheduling of multipipeline crude oil blending

Discrete optimization via simulation: algorithms and error control