Abstract:In statistical inference, we commonly assume that samples are independent and identically distributed from a probability distribution included in a pre-specified statistical model. However, such an assumption is often violated in practice. Even an unexpected extreme sample called an {\it outlier} can significantly impact classical estimators. Robust statistics studies how to construct reliable statistical methods that efficiently work even when the ideal assumption is violated. Recently, some works revealed that robust estimators such as Tukey's median are well approximated by the generative adversarial net (GAN), a popular learning method for complex generative models using neural networks. GAN is regarded as a learning method using integral probability metrics (IPM), which is a discrepancy measure for probability distributions. In most theoretical analyses of Tukey's median and its GAN-based approximation, however, the Gaussian or elliptical distribution is assumed as the statistical model. In this paper, we explore the application of GAN-like estimators to a general class of statistical models. As the statistical model, we consider the kernel exponential family that includes both finite and infinite-dimensional models. To construct a robust estimator, we propose the smoothed total variation (STV) distance as a class of IPMs. Then, we theoretically investigate the robustness properties of the STV-based estimators. Our analysis reveals that the STV-based estimator is robust against the distribution contamination for the kernel exponential family. Furthermore, we analyze the prediction accuracy of a Monte Carlo approximation method, which circumvents the computational difficulty of the normalization constant.

On a Robust Variogram Estimator

Study on Variogram Robustness

M-estimator Based Support Vector Machine and Its Application

Local Linear M‐estimation in Non‐parametric Spatial Regression

Robust Estimation and Outlier Detection for Varying-Coefficient Models Via Penalized Regression

Robust Kernel Recursive Adaptive Filtering Algorithms Based on M-estimate

Robust LS-SVR Based on Variational Bayesian and Its Applications

Principles and Validation of Unified Approach for Nested Overlap of Geological Variable Variograms

Robust Estimation for Kernel Exponential Families with Smoothed Total Variation Distances

Robust Estimation for Function-on-scalar Regression Models

Robust variable selection for the varying index coefficient models

On Prediction Properties of Kriging: Uniform Error Bounds and Robustness

Robust variable selection with exponential squared loss for the partially linear varying coefficient spatial autoregressive model

Huber Loss Meets Spatial Autoregressive Model: A Robust Variable Selection Method with Prior Information

Robust Variable Selection with Exponential Squared Loss for the Spatial Single-Index Varying-Coefficient Model

Kriging prediction with isotropic Matérn correlations: Robustness and experimental design

Three Dimensional Probability Modeling Using Indicator Kriging Method

Robust small area estimation for unit level model with density power divergence

Correlation-Based Robust Linear Regression with Iterative Outlier Removal

Robust Variational Inference

Robust MAVE for single-index varying-coefficient models