Abstract:With the progress of measurement apparatus and the development of automatic sensors, it is not unusual anymore to get large samples of observations taking values in high-dimension spaces, such as functional spaces. In such large samples of high-dimensional data, outlying curves may not be uncommon, and even a few individuals may corrupt simple statistical indicators, such as the mean trajectory. We focus here on the estimation of the geometric median which is a direct generalization of the real median in metric spaces and has nice robustness properties. It is possible to estimate the geometric median, being defined as the minimizer of a simple convex functional that is differentiable everywhere when the distribution has no atom, with online gradient algorithms. Such algorithms are very fast and can deal with large samples. Furthermore, they also can be simply updated when the data arrive sequentially. We state the almost sure consistency and the $L^{2}$ rates of convergence of the stochastic gradient estimator as well as the asymptotic normality of its averaged version. We get that the asymptotic distribution of the averaged version of the algorithm is the same as the classic estimators, which are based on the minimization of the empirical loss function. The performances of our averaged sequential estimator, both in terms of computation speed and accuracy of the estimations, are evaluated with a small simulation study. Our approach is also illustrated on a sample of more than 5000 individual television audiences measured every second over a period of 24 hours.

Online stochastic Newton methods for estimating the geometric median and applications

Online estimation of the geometric median in Hilbert spaces : non asymptotic confidence balls

Efficient and fast estimation of the geometric median in Hilbert spaces with an averaged stochastic gradient algorithm

The Geometric Median and Applications to Robust Mean Estimation

Online estimation of the inverse of the Hessian for stochastic optimization with application to universal stochastic Newton algorithms

Online estimation of the asymptotic variance for averaged stochastic gradient algorithms

On the asymptotic rate of convergence of Stochastic Newton algorithms and their Weighted Averaged versions

SGD with Clipping is Secretly Estimating the Median Gradient

Automatic optimal-rate convergence of randomized nets using median-of-means

Robust empirical risk minimization via Newton's method

Stochastic iterative methods for online rank aggregation from pairwise comparisons

Online Updating of Statistical Inference in the Big Data Setting

Tight Nonparametric Convergence Rates for Stochastic Gradient Descent under the Noiseless Linear Model

Online Covariance Matrix Estimation in Stochastic Gradient Descent

Stochastic gradient descent methods for estimation with large data sets

Online Inference with Debiased Stochastic Gradient Descent

Online and Offline Robust Multivariate Linear Regression

Communication-efficient Distributed Newton-like Optimization with Gradients and M-estimators

Online covariance estimation for stochastic gradient descent under Markovian sampling

Integrating Big Data and Survey Data for Efficient Estimation of the Median