Abstract:In statistical inference, we commonly assume that samples are independent and identically distributed from a probability distribution included in a pre-specified statistical model. However, such an assumption is often violated in practice. Even an unexpected extreme sample called an {\it outlier} can significantly impact classical estimators. Robust statistics studies how to construct reliable statistical methods that efficiently work even when the ideal assumption is violated. Recently, some works revealed that robust estimators such as Tukey's median are well approximated by the generative adversarial net (GAN), a popular learning method for complex generative models using neural networks. GAN is regarded as a learning method using integral probability metrics (IPM), which is a discrepancy measure for probability distributions. In most theoretical analyses of Tukey's median and its GAN-based approximation, however, the Gaussian or elliptical distribution is assumed as the statistical model. In this paper, we explore the application of GAN-like estimators to a general class of statistical models. As the statistical model, we consider the kernel exponential family that includes both finite and infinite-dimensional models. To construct a robust estimator, we propose the smoothed total variation (STV) distance as a class of IPMs. Then, we theoretically investigate the robustness properties of the STV-based estimators. Our analysis reveals that the STV-based estimator is robust against the distribution contamination for the kernel exponential family. Furthermore, we analyze the prediction accuracy of a Monte Carlo approximation method, which circumvents the computational difficulty of the normalization constant.

Robust Estimation in Stochastic Frontier Models

Robust estimation in a nonlinear cointegration model

Robust M-Estimation for Additive Single-Index Cointegrating Time Series Models

Unified robust estimation

Robust estimation for general integer-valued time series models

A Robust Adaptive FIR Filter Based on M-Estimation

Efficient Bias Robust Cross Section Factor Models

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Robust State Estimation for Uncertain Discrete-Time Stochastic Systems with Missing Measurements

A Note on the Consistency of a Robust Estimator for Threshold Autoregressive Processes

Robust State Estimation for Uncertain Linear Systems with Random Parametric Uncertainties

Robust estimation in finite population sampling

Robust estimation of panel data regression models and applications

Robust Estimation for Kernel Exponential Families with Smoothed Total Variation Distances

Robust explicit estimators using the power-weighted repeated medians

Robust Estimation for Generalized Additive Models

Robust estimation in joint mean–covariance regression model for longitudinal data

Doubly Robust Semiparametric Inference Using Regularized Calibrated Estimation with High-dimensional Data

Confidence regions in Wasserstein distributionally robust estimation

Robust Confidence Bands for Stochastic Processes Using Simulation

Robust realized integrated beta estimator with application to dynamic analysis of integrated beta