Abstract:Estimating the unconstrained mean and covariance matrix is a popular topic in statistics. However, estimation of the parameters of $N_p(\mu,\Sigma)$ under joint constraints such as $\Sigma\mu = \mu$ has not received much attention. It can be viewed as a multivariate counterpart of the classical estimation problem in the $N(\theta,\theta^2)$ distribution. In addition to the usual inference challenges under such non-linear constraints among the parameters (curved exponential family), one has to deal with the basic requirements of symmetry and positive definiteness when estimating a covariance matrix. We derive the non-linear likelihood equations for the constrained maximum likelihood estimator of $(\mu,\Sigma)$ and solve them using iterative methods. Generally, the MLE of covariance matrices computed using iterative methods do not satisfy the constraints. We propose a novel algorithm to modify such (infeasible) estimators or any other (reasonable) estimator. The key step is to re-align the mean vector along the eigenvectors of the covariance matrix using the idea of regression. In using the Lagrangian function for constrained MLE (Aitchison et al. 1958), the Lagrange multiplier entangles with the parameters of interest and presents another computational challenge. We handle this by either iterative or explicit calculation of the Lagrange multiplier. The existence and nature of location of the constrained MLE are explored within a data-dependent convex set using recent results from random matrix theory. A simulation study illustrates our methodology and shows that the modified estimators perform better than the initial estimators from the iterative methods.

Estimating the correlation coefficient in the presence of correlated observations from a bivariate normal population

Estimators of the correlation coefficient in the bivariate exponential distribution

Monotonicity properties of the asymptotic relative efficiency between common correlation statistics in the bivariate normal model

Robust estimation and test for Pearson's correlation coefficient

A short note on the maximal point-biserial correlation under non-normality

On the distribution of the correlation coefficient when sampling from a mixture of two bivariate normal densities: Robustness and the effect of outliers

Robust Estimation of Polychoric Correlation

The effect of normality and outliers on bivariate correlation coefficients in psychology: A Monte Carlo simulation

Iteratively Reweighted Least Squares Method for Estimating Polyserial and Polychoric Correlation Coefficients

Estimating correlations among elliptically distributed random variables under any form of heteroskedasticity

Moderate Deviation Principle for the Determinant of Sample Correlation Matrix

Regression models of Pearson correlation coefficient

Comparison of Spearman's rho and Kendall's tau in Normal and Contaminated Normal Models

Robust Estimating Equations and Bias Correction of Correlation Parameters for Longitudinal Data

MLE of Jointly Constrained Mean-Covariance of Multivariate Normal Distributions

A smooth simultaneous confidence band for correlation curve

Asymptotic Robustness Study of the Polychoric Correlation Estimation

On Correlation and Prediction Interval Reduction

Corruption of the Pearson correlation coefficient by measurement error and its estimation, bias, and correction under different error models

Separable correlation and maximum likelihood