Abstract:In statistical inference, we commonly assume that samples are independent and identically distributed from a probability distribution included in a pre-specified statistical model. However, such an assumption is often violated in practice. Even an unexpected extreme sample called an {\it outlier} can significantly impact classical estimators. Robust statistics studies how to construct reliable statistical methods that efficiently work even when the ideal assumption is violated. Recently, some works revealed that robust estimators such as Tukey's median are well approximated by the generative adversarial net (GAN), a popular learning method for complex generative models using neural networks. GAN is regarded as a learning method using integral probability metrics (IPM), which is a discrepancy measure for probability distributions. In most theoretical analyses of Tukey's median and its GAN-based approximation, however, the Gaussian or elliptical distribution is assumed as the statistical model. In this paper, we explore the application of GAN-like estimators to a general class of statistical models. As the statistical model, we consider the kernel exponential family that includes both finite and infinite-dimensional models. To construct a robust estimator, we propose the smoothed total variation (STV) distance as a class of IPMs. Then, we theoretically investigate the robustness properties of the STV-based estimators. Our analysis reveals that the STV-based estimator is robust against the distribution contamination for the kernel exponential family. Furthermore, we analyze the prediction accuracy of a Monte Carlo approximation method, which circumvents the computational difficulty of the normalization constant.

Statistical inference in the partial linear models with the inverse gaussian kernel

Oracally efficient spline-backfitted kernel smoothing of additive partial linear measurement error model

Statistical Inference in the Partial Functional Linear Expectile Regression Model

Empirical-Likelihood-Based Inference for Partially Linear Models

FUSED KERNEL-SPLINE SMOOTHING FOR REPEATEDLY MEASURED OUTCOMES IN A GENERALIZED PARTIALLY LINEAR MODEL WITH FUNCTIONAL SINGLE INDEX

A KERNEL-BASED METHOD FOR ESTIMATING ADDITIVE PARTIALLY LINEAR MODELS

Spline-Backfitted Kernel Smoothing of Partially Linear Additive Model

Some Asymptotic Properties for Multivariate Partially Linear Models

Efficient and fast spline-backfitted kernel smoothing of additive models

Skew-normal Partial Functional Linear Model and Homogeneity Test

Kernel-based Estimation for Partially Functional Linear Model: Minimax Rates and Randomized Sketches

Generalized Kernel-Based Inverse Regression Methods for Sufficient Dimension Reduction

Statistical Inference for Partially Linear Regression Models with Measurement Errors

Inference for generalized partial functional linear regression

A Note on the Optimal Smoothing in Partial Linear Models with Penalized Least Squares Estimator

Statistical Inference on Partially Linear Additive Models with Missing Response Variables and Error-Prone Covariates

Statistical Inference for Multivariate Partially Linear Regression Models

Adaptive Bayesian nonparametric regression using kernel mixture of polynomials with application to partial linear model

Statistical inference for partially linear stochastic models with heteroscedastic errors.

Robust Estimation for Kernel Exponential Families with Smoothed Total Variation Distances

Robust estimation of the generalised partial linear model with missing covariates