An Efficiency and Convergence Analysis of Multi-Fidelity Optimization with Ordinal Transformation and Optimal Sampling.

Yunzhe Qiu,Jie Song
DOI: https://doi.org/10.1109/icit.2016.7474886
2016-01-01
Abstract:Simulation and analytical tools are useful modeling methods to solve complex optimization problems. In this paper, we propose a simulation optimization framework called "Multi-fidelity Optimization with Ordinal Transformation and Optimal Sampling" (MO 2 TOS) when multi-fidelity models are available, and prove its efficiency by analyzing its convergence mechanism. The MO 2 TOS is a two-stage method combining the information of both low- and high-fidelity models. In the Ordinal Transformation (OT) stage, the low-fidelity model is estimated to rank candidates and to partition the solution set into groups, while in the Optimal Sampling (OS) stage, the Optimal Computing Budget Allocation (OCBA) rule guides the sampling budget allocated to each group. We derive the convergence pattern of the expected gap between true and observed optimums using MO 2 TOS, and compare its performance with other methods. Related numerical experiments validate the efficiency of MO 2 TOS and the derived convergence pattern.
What problem does this paper attempt to address?