Abstract:In statistical inference, we commonly assume that samples are independent and identically distributed from a probability distribution included in a pre-specified statistical model. However, such an assumption is often violated in practice. Even an unexpected extreme sample called an {\it outlier} can significantly impact classical estimators. Robust statistics studies how to construct reliable statistical methods that efficiently work even when the ideal assumption is violated. Recently, some works revealed that robust estimators such as Tukey's median are well approximated by the generative adversarial net (GAN), a popular learning method for complex generative models using neural networks. GAN is regarded as a learning method using integral probability metrics (IPM), which is a discrepancy measure for probability distributions. In most theoretical analyses of Tukey's median and its GAN-based approximation, however, the Gaussian or elliptical distribution is assumed as the statistical model. In this paper, we explore the application of GAN-like estimators to a general class of statistical models. As the statistical model, we consider the kernel exponential family that includes both finite and infinite-dimensional models. To construct a robust estimator, we propose the smoothed total variation (STV) distance as a class of IPMs. Then, we theoretically investigate the robustness properties of the STV-based estimators. Our analysis reveals that the STV-based estimator is robust against the distribution contamination for the kernel exponential family. Furthermore, we analyze the prediction accuracy of a Monte Carlo approximation method, which circumvents the computational difficulty of the normalization constant.

Statistical Estimations for Non-Ergodic Vasicek Model Driven by Two Types of Gaussian Processes

Least Squares Estimation for the Drift Parameters in the Sub-Fractional Vasicek Processes

Maximum Likelihood Estimation for Mixed Fractional Vasicek Processes

Generation of two correlated stationary Gaussian processes and application to ship rolling motion

ASYMPTOTIC THEORY FOR ESTIMATING DRIFT PARAMETERS IN THE FRACTIONAL VASICEK MODEL

Kernel Generated Two-Time Parameter Gaussian Processes and Some of Their Path Properties

Two-step estimation of ergodic Lévy driven SDE

Robust Estimation for Kernel Exponential Families with Smoothed Total Variation Distances

Maximum likelihood estimation in the non-ergodic fractional Vasicek model

Inference for Gaussian Processes with Matérn Covariogram on Compact Riemannian Manifolds

Multivariate stochastic Vasicek diffusion process: computational estimation and application to the analysis of $$CO_2$$ and $$N_2O$$ concentrations

Bernstein-von Mises theorems for time evolution equations

A Gaussian Process Regression Model for Distribution Inputs

A Unifying Framework for Global Gaussianization: Asymptotic Equivalence of Locally Stationary Processes and Bivariate White Noise

Asymptotic properties of parameter estimators in Vasicek model driven by tempered fractional Brownian motion

An Improved Berry-Esseen Bound of Least Squares Estimation for Fractional Ornstein-Uhlenbeck Processes

Vector-valued Gaussian processes on non-Euclidean product spaces: constructive methods and fast simulations based on partial spectral inversion

Asymptotic Properties for the Parameter Estimation in Ornstein-Uhlenbeck Process with Discrete Observations

Asymptotic properties of the maximum likelihood and cross validation estimators for transformed Gaussian processes

Asymptotic properties of Vecchia approximation for Gaussian processes

Cramér-type Moderate Deviations for Statistics in the Non-Stationary Ornstein–Uhlenbeck Process