Abstract:In statistical inference, we commonly assume that samples are independent and identically distributed from a probability distribution included in a pre-specified statistical model. However, such an assumption is often violated in practice. Even an unexpected extreme sample called an {\it outlier} can significantly impact classical estimators. Robust statistics studies how to construct reliable statistical methods that efficiently work even when the ideal assumption is violated. Recently, some works revealed that robust estimators such as Tukey's median are well approximated by the generative adversarial net (GAN), a popular learning method for complex generative models using neural networks. GAN is regarded as a learning method using integral probability metrics (IPM), which is a discrepancy measure for probability distributions. In most theoretical analyses of Tukey's median and its GAN-based approximation, however, the Gaussian or elliptical distribution is assumed as the statistical model. In this paper, we explore the application of GAN-like estimators to a general class of statistical models. As the statistical model, we consider the kernel exponential family that includes both finite and infinite-dimensional models. To construct a robust estimator, we propose the smoothed total variation (STV) distance as a class of IPMs. Then, we theoretically investigate the robustness properties of the STV-based estimators. Our analysis reveals that the STV-based estimator is robust against the distribution contamination for the kernel exponential family. Furthermore, we analyze the prediction accuracy of a Monte Carlo approximation method, which circumvents the computational difficulty of the normalization constant.

Statistical visualisation of tidy and geospatial data in R via kernel smoothing methods in the eks package

Statistical visualisation for tidy and geospatial data in R via kernel smoothing methods in the eks package

The GeometricKernels Package: Heat and Matérn Kernels for Geometric Learning on Manifolds, Meshes, and Graphs

A framework to embed a spatial statistics toolbox in open-source GIS software: kernel density estimation example

Kryging: Geostatistical analysis of large-scale datasets using Krylov subspace methods

Fast Kernel Smoothing in R with Applications to Projection Pursuit

Visual Process Monitoring by Data-Dependent Kernel Discriminant Analysis with T-Distributed Similarities.

Data-Dependent Kernel Discriminant Analysis for Feature Extraction and Classification

Kernel Smoothing, Mean Shift, and Their Learning Theory with Directional Data

MIK: Modified Isolation Kernel for Biological Sequence Visualization, Classification, and Clustering

A visualization tool for the kernel-driven model with improved ability in data analysis and kernel assessment

Consistent second-order discrete kernel smoothing using dispersed Conway-Maxwell-Poisson kernels

Kernel Smoothing for Nested Estimation with Application to Portfolio Risk Measurement.

Randomized kernels for large scale Earth observation applications

Automated optimized parameters for T-distributed stochastic neighbor embedding improve visualization and analysis of large datasets

Exploring the Efficacy of Statistical and Deep Learning Methods for Large Spatial Datasets: A Case Study

Robust Estimation for Kernel Exponential Families with Smoothed Total Variation Distances

A Spatio-Temporal Kernel Density Estimation Framework for Predictive Crime Hotspot Mapping and Evaluation

Kernel Ordinary Differential Equations

A General-Purpose Machine Learning R Library for Sparse Kernels Methods With an Application for Genome-Based Prediction

Kernel Sum of Squares for Data Adapted Kernel Learning of Dynamical Systems from Data: A global optimization approach