Abstract:The inefficiency of using an unbiased estimator in a Monte Carlo procedure can be quantified using an inefficiency constant, equal to the product of the variance of the estimator and its mean computational cost. We develop methods for obtaining the parameters of the importance sampling (IS) change of measure via single- and multi-stage minimization of well-known estimators of cross-entropy and the mean square of the IS estimator, as well as of new estimators of such a mean square and inefficiency constant. We prove the convergence and asymptotic properties of the minimization results in our methods. We show that if a zero-variance IS parameter exists, then, under appropriate assumptions, minimization results of the new estimators converge to such a parameter at a faster rate than such results of the well-known estimators, and a positive definite asymptotic covariance matrix of the minimization results of the cross-entropy estimators is four times such a matrix for the well-known mean square estimators. We introduce criteria for comparing the asymptotic efficiency of stochastic optimization methods, applicable to the minimization methods of estimators considered in this work. In our numerical experiments for computing expectations of functionals of an Euler scheme, the minimization of the new estimators led to the lowest inefficiency constants and variances of the IS estimators, followed by the minimization of the well-known mean square estimators, and the cross-entropy ones.

Asymptotically efficient estimation under local constraint in Wicksell's problem

Adaptive and efficient isotonic estimation in Wicksell's problem

Asymptotic Distributions of Innovation Density Estimators in Linear Processes

An equilibrated estimator for mixed finite element discretizations of the curl-curl problem

On the Asymptotic Approximation of Inverse Moment under Sub-Linear Expectations

Empirical measures and random walks on compact spaces in the quadratic Wasserstein metric

Adaptive importance sampling via minimization of estimators of cross-entropy, mean square, and inefficiency constant

Efficient estimation for diffusions sampled at high frequency over a fixed time interval

Malliavin calculus for the optimal estimation of the invariant density of discretely observed diffusions in intermediate regime

Two New Families of Local Asymptotically Minimax Lower Bounds in Parameter Estimation

Efficient Estimation in Single Index Models through Smoothing splines

Linear Model Estimators and Consistency under an Infill Asymptotic Domain

Rate of convergence of the smoothed empirical Wasserstein distance

Needlet-Whittle Estimates on the Unit Sphere

Efficient Estimation of Partially Linear Models for Spatial Data over Complex Domain

Asymptotics of Estimates in Constrained Nonlinear Regression with Long-Range Dependent Innovations

Adaptive Estimation and Uniform Confidence Bands for Nonparametric Structural Functions and Elasticities

Efficiency of estimators for locally asymptotically normal quantum statistical models

Efficiency of the averaged rank-based estimator for first order Sobol index inference

Inexpensive polynomial-degree-robust equilibrated flux a posteriori estimates for isogeometric analysis