Abstract:Model calibration is challenging for large-scale system models with a great number of variables. Existing approaches to partitioning system models and prioritizing data acquisition rely on heuristics rather than formal treatments. The sensor placement problem in physical dynamic systems points to a promising avenue for formalizing data acquisition priorities, which addresses the following question for system models: With the model at hand and pre-existing data availability on a subset of model variables, what are the (next) k model variables that would bring the largest utility to model calibration, once their data are acquired? In this study, we formalize this problem as a combinatorial optimization and adapt two solutions, the information-entropy approach and the miss-probability approach, from physical dynamic systems to system models in management sciences. Next, based on the idea of the data availability partition, we develop a third solution. The new approach can be understood from the entropy perspective and is embedded in the theoretical framework for the evaluation of side information. Our solution applies to system models of all topologies: analytical results of the optimal placement are derived for binary/multinary trees; for general (directed) tree structures, an algorithm to determine the optimal placement is devised, whose complexity is upper-bounded by [Formula: see text] for an n-variable system; for arbitrary model topologies with the presence of loops, sequential-optimal and simulated-annealing schemes are formulated. Three approaches are compared on a validating example; our solution outperforms the two alternatives. Application on a multicompartment system demonstrates the toolkit’s practical use. History: Accepted by Pascal Van Hentenryck, Area Editor for Computational Modeling: Methods & Analysis. Supplemental Material: The software that supports the findings of this study is available within the paper and its Supplemental Information ( https://pubsonline.informs.org/doi/suppl/10.1287/ijoc.2022.0128 ) as well as from the IJOC GitHub software repository ( https://github.com/INFORMSJoC/2022.0128 ). The complete IJOC Software and Data Repository is available at https://informsjoc.github.io/ .

Measurement Optimization under Uncertainty using Deep Reinforcement Learning

Model-Based Robot Learning Control with Uncertainty Directed Exploration

Deep Reinforcement Learning Sensor Scheduling for Effective Monitoring of Dynamical Systems

Deep Optimal Sensor Placement for Black Box Stochastic Simulations

Real-Time Measurement-Driven Reinforcement Learning Control Approach for Uncertain Nonlinear Systems

Reinforcement Learning-Based Optimal Sensor Placement for Spatiotemporal Modeling

Machine Learning-Based System Optimization and Uncertainty Quantification for Integrated Systems

Uncertainty-Aware Policy Optimization: A Robust, Adaptive Trust Region Approach

Estimation and Control Using Sampling-Based Bayesian Reinforcement Learning

Multi-objective Optimization for Sensor Placement: an Integrated Combinatorial Approach with Reduced Order Model and Gaussian Process

Optimal Decision-Making in Mixed-Agent Partially Observable Stochastic Environments via Reinforcement Learning

Actively Learning Reinforcement Learning: A Stochastic Optimal Control Approach

Robust Active Measuring under Model Uncertainty

Dynamic Measurement Scheduling for Event Forecasting using Deep RL

Uncertainty-Aware Reinforcement Learning for Portfolio Optimization

Decision Making for Human-in-the-loop Robotic Agents via Uncertainty-Aware Reinforcement Learning

Dynamic Measurement Scheduling for Adverse Event Forecasting using Deep RL

Automation of Strategic Data Prioritization in System Model Calibration: Sensor Placement

Modelling resource allocation in uncertain system environment through deep reinforcement learning

Deep reinforcement learning for intelligent risk optimization of buildings under hazard

Deep Deterministic Portfolio Optimization