Abstract:In various industrial contexts, estimating the distribution of unobserved random vectors Xi from some noisy indirect observations H(Xi) + Ui is required. If the relation between Xi and the quantity H(Xi), measured with the error Ui, is implemented by a CPU-consuming computer model H, a major practical difficulty is to perform the statistical inference with a relatively small number of runs of H. Following Fu et al. (2014), a Bayesian statistical framework is considered to make use of possible prior knowledge on the parameters of the distribution of the Xi, which is assumed Gaussian. Moreover, a Markov Chain Monte Carlo (MCMC) algorithm is carried out to estimate their posterior distribution by replacing H by a kriging metamodel build from a limited number of simulated experiments. Two heuristics, involving two different criteria to be optimized, are proposed to sequentially design these computer experiments in the limits of a given computational budget. The first criterion is a Weighted Integrated Mean Square Error (WIMSE). The second one, called Expected Conditional Divergence (ECD), developed in the spirit of the Stepwise Uncertainty Reduction (SUR) criterion, is based on the discrepancy between two consecutive approximations of the target posterior distribution. Several numerical comparisons conducted over a toy example then a motivating real case-study show that such adaptive designs can significantly outperform the classical choice of a maximin Latin Hypercube Design (LHD) of experiments. Dealing with a major concern in hydraulic engineering, a particular emphasis is placed upon the prior elicitation of the case-study, highlighting the overall feasibility of the methodology. Faster convergences and manageability considerations lead to recommend the use of the ECD criterion in practical applications.

Online Statistical Inference for Stochastic Optimization via Gradient-free Kiefer-Wolfowitz Methods

Online Statistical Inference for Stochastic Optimization via Kiefer-Wolfowitz Methods

Statistical Inference for Polyak-Ruppert Averaged Zeroth-order Stochastic Gradient Algorithm

Scalable Statistical Inference in Non-parametric Least Squares

Statistical Inference for Online Decision Making via Stochastic Gradient Descent

A New Reliability Method Combining Adaptive Kriging and Active Variance Reduction Using Multiple Importance Sampling

An adaptive kriging method for solving nonlinear inverse statistical problems

High Confidence Level Inference is Almost Free using Parallel Stochastic Optimization

Online Inference with Debiased Stochastic Gradient Descent

Optimization of Expensive Black-Box Problems Via Gradient-enhanced Kriging

A stochastic use of the Kurdyka-Lojasiewicz property: Investigation of optimization algorithms behaviours in a non-convex differentiable framework

Scalable Stochastic Kriging with Markovian Covariances

Online Updating of Statistical Inference in the Big Data Setting

A Statistical Online Inference Approach in Averaged Stochastic Approximation

A relaxation-based probabilistic approach for PDE-constrained optimization under uncertainty with pointwise state constraints

Convergence Analysis of Stochastic Kriging-Assisted Simulation with Random Covariates

Online Statistical Inference for Nonlinear Stochastic Approximation with Markovian Data

Derivative-Free Optimization via Finite Difference Approximation: An Experimental Study

Online Confidence Interval Estimation for Federated Heterogen-Eous Optimization

A KL-based Analysis Framework with Applications to Non-Descent Optimization Methods

Stochastic gradient descent, weighted sampling, and the randomized Kaczmarz algorithm