Experimental Design : Optimizing Quantities of Interest to Reliably Reduce the Uncertainty in Model Input Parameters

Scott Walsh
DOI: https://doi.org/10.48550/arXiv.1601.06702
2016-01-26
Abstract:As stakeholders and policy makers increasingly rely upon quantitative predictions from advanced computational models, a problem of fundamental importance is the quantification and reduction of uncertainties in both model inputs and output data. The typical work-flow in the end-to-end quantification of uncertainties requires first formulating and solving stochastic inverse problems (SIPs) using output data on available quantities of interest (QoI). The solution to a SIP is often written in terms of a probability measure, or density, on the space of model inputs. Then, we can formulate and solve a stochastic forward problem (SFP) where the uncertainty on model inputs is propagated through the model to make quantitative predictions on either unobservable or future QoI data. In this work, we use a measure-theoretic framework to formulate and solve both SIPs and SFPs. From this perspective, we quantify the geometric characteristics of using hypothetical sets of QoI that describe both the precision and accuracy in solutions to both the SIP and SFP. This leads to a natural definition of the optimal experimental design, i.e., what the optimal configuration a finite set of sensors is in space-time. Several numerical examples and applications are discussed including the ADvanced CIRCulation (ADCIRC) model using simulated data from Hurricane Gustav to determine an optimal placement of buoys in the Gulf of Mexico to capture high water marks of the storm surge in order to reduce uncertainties in bottom roughness characteristics.
Numerical Analysis
What problem does this paper attempt to address?
The problem that this paper attempts to solve is how to reliably reduce the uncertainty in model input parameters by optimizing Quantities of Interest (QoI). Specifically, the author focuses on how to use data obtained from experiments or observations to improve the predictive ability of the model when facing the mathematical modeling of complex physical systems. ### Problem Background 1. **Uncertainty of Model Parameters**: Modern computing resources enable us to simulate extremely complex physical systems, but these complex models usually contain many uncertain input parameters. For example, in the process of simulating a heated thin plate, the diffusion coefficient may be uncertain due to manufacturing defects; in the coastal storm surge model, the Manning’s n parameter may also introduce uncertainty due to the change of the coastal boundary in each storm. 2. **Uncertainty of Data**: The QoI collected from physical systems (such as the temperature measurement value at a certain space - time point or the maximum water level at a given location) also has uncertainty itself, due to reasons such as the limited accuracy of the measuring instrument and the uncertainty of the instrument location. ### Research Objectives The main objective of the paper is to reduce the uncertainty in model input parameters by selecting the optimal QoI, thereby improving the predictive ability of the model. Specifically: - **Inverse Problem**: The author proposes a method based on measure theory to solve the set - valued inverse problem caused by the uncertainty of QoI. Through this method, it can be determined which model input parameters may have led to the observed data. - **Multi - Criterion Optimization**: In order to optimize precision and accuracy simultaneously, the author introduces two geometric characteristic indicators: µΛ - measure and skewness. The former measures the precision of the solution, and the latter measures the accuracy of the solution. - **Experimental Design Optimization**: By optimizing the selection of QoI, accurate prediction results can be obtained with a relatively small number of model evaluations. This involves how to select an observation network that can best reduce parameter uncertainty under limited computing resources. ### Solutions The paper proposes a framework based on measure theory to solve these problems and realizes the approximation of the inverse problem solution through a numerical algorithm. The specific steps include: 1. **Establishing a Measure Theory Framework**: Define the forward problem and the corresponding inverse problem, and introduce the concept of generalized contours. 2. **Numerical Approximation**: Develop a non - invasive computing algorithm to approximate the probability measure of the inverse problem. 3. **Multi - Criterion Optimization**: By optimizing µΛ - measure and skewness, find the optimal QoI combination to ensure high precision and high accuracy of the inverse problem solution. ### Summary In general, this paper aims to reduce the uncertainty in model input parameters by optimizing the selection of QoI, thereby improving the predictive ability of the model. By combining measure theory and numerical methods, the author provides a systematic method to solve this problem and shows its potential in practical applications.