Abstract:We propose a steepest descent method to compute optimal control parameters for balancing between multiple performance objectives in stateless stochastic scheduling, wherein the scheduling decision is effected by a simple constant-time coin toss operation only. We apply our method to the scheduling of a mobile sensor's coverage time among a set of points of interest (PoIs). The coverage algorithm is guided by a Markov chain wherein the sensor at PoI i decides to go to the next PoI j with transition probability pij. We use steepest descent to compute the transition probabilities for optimal tradeoff between two performance goals concerning the distributions of per-PoI coverage times and exposure times, respectively. We also discuss how other important goals such as energy efficiency and entropy of the coverage schedule can be addressed. For computational efficiency, we show how to optimally adapt the step size in steepest descent to achieve fast convergence. However, we found that the structure of our problem is complex in that there may exist surprisingly many local optima in the solution space, causing basic steepest descent to get stuck easily at a local optimum. To solve the problem, we show how proper incorporation of noise in the search process can get us out of the local optima with high probability. We provide simulation results to verify the accuracy of our analysis, and show that our method can converge to the globally optimal control parameters under different assigned weights to the performance goals and different initial parameters.

Selection of the Best in the Presence of Subjective Stochastic Constraints

Pruning inferior systems using subjective constraints with sequentially added thresholds

Indifference-Zone-Free Selection of the Best

A Relative Feasibility Degree Based Approach for Constrained Optimization Problems.

Stochastic Steepest-Descent Optimization Of Multiple-Objective Mobile Sensor Coverage

Chance Constrained Selection of the Best.

Selecting the Best Simulated Design with the Expected Opportunity Cost Bound.

A frequentist selection-of-the-best procedure without indifference zone

A sequential procedure for neighborhood selection-of-the-best in optimization via simulation

Efficient Dynamic Allocation Policy for Robust Ranking and Selection under Stochastic Control Framework

Fully Sequential Indifference‐zone Selection Procedures with Variance‐dependent Sampling

Distributionally Robust Selection of the Best

Selecting the Best System when Systems Are Revealed Sequentially

Approximately Optimal Computing Budget Allocation for Selection of the Best and Worst Designs.

A New Methodology for Robust Optimizations of Optimal Design Problems under Interval Uncertainty

A New Framework of Designing Sequential Ranking-and-selection Procedures.

Interval Multiobjective Optimization of Structures Based on Radial Basis Function, Interval Analysis, and NSGA-II

Adaptive Sequential Procedures for Quantile Selection with Importance Sampling

An Optimal Opportunity Cost Selection Procedure for A Fixed Number of Designs

Data-driven Ranking and Selection under Input Uncertainty

An Indifference-Zone Selection Procedure with Minimum Switching and Sequential Sampling