Abstract:We observe n pairs of independent (but not necessarily i.i.d.) random variables X1=(W1,Y1),...,Xn=(Wn,Yn) and tackle the problem of estimating the conditional distributions Qi⋆(wi) of Yi given Wi=wi for all i∈{1,...,n} . Even though these might not be true, we base our estimator on the assumptions that the data are i.i.d. and the conditional distributions of Yi given Wi=wi belong to a one parameter exponential family Q ̄ with parameter space given by an interval I . More precisely, we pretend that these conditional distributions take the form Qθ(wi)∈Q ̄ for some θ that belongs to a VC-class Θ ̄ of functions with values in I . For each i∈{1,...,n} , we estimate Qi⋆(wi) by a distribution of the same form, i.e. Qθ̂(wi)∈Q ̄ , where θ̂=θ̂(X1,...,Xn) is a well-chosen estimator with values in Θ ̄ . We establish non-asymptotic exponential inequalities for the upper deviations of a Hellinger-type distance between the true conditional distributions of the data and the estimated one based on the exponential family Q ̄ and the class of functions Θ ̄ we chose. We show that our estimation strategy is robust to model misspecification, contamination and the presence of outliers. Besides, when the data are truly i.i.d., the exponential family Q ̄ is suitably parametrized and the conditional distributions Qi⋆(wi) of the form Qθ⋆(wi)∈Q ̄ for some unknown Hölderian function θ⋆ with values in I , we prove that the estimator θ̂ of θ⋆ is minimax (up to a logarithmic factor). Finally, we provide an algorithm for calculating θ̂ when Θ ̄ is a VC-class of functions of low or moderate dimension and we carry out a simulation study to compare its performance to that of the MLE and median-based estimators. The proof of our main result relies on an upper bound, with explicit numerical constants, on the expectation of the supremum of an empirical process over a VC-subgraph class. This bound can be of independent interest.

Estimators of the correlation coefficient in the bivariate exponential distribution

Estimation of Correlation Coefficient under a Linear Multiplicative Distortion Measurement Errors Model.

Comparison of correlation-based measures of concordance in terms of asymptotic variance

Estimating the correlation coefficient in the presence of correlated observations from a bivariate normal population

An Improved Estimator for the Correlation Function of 2D Nonlinear Sigma Models

Kendall Correlation Coefficients for Portfolio Optimization

On The Error-Estimates Of Correlation-Functions

A new coefficient of correlation

Concentration inequalities for the sample correlation coefficient

Monotonicity properties of the asymptotic relative efficiency between common correlation statistics in the bivariate normal model

Measuring Linear Correlation Between Random Vectors

Robust estimation of a regression function in exponential families

Covariance Ratio under Multiplicative Distortion Measurement Errors

The relation between Pearson's correlation coefficient r and Salton's cosine measure

On Correlation Coefficients

Correlation Estimation System Minimization Compared to Least Squares Minimization in Simple Linear Regression

A smooth simultaneous confidence band for correlation curve

Measuring the symmetry of model errors for varying coefficient regression models based on correlation coefficient

Asymptotic confidence interval for R2 in multiple linear regression

Limiting Spectral Distribution of Large Dimensional Spearman?s Rank Correlation Matrices

Corruption of the Pearson correlation coefficient by measurement error and its estimation, bias, and correction under different error models