Abstract:Estimating the unconstrained mean and covariance matrix is a popular topic in statistics. However, estimation of the parameters of $N_p(\mu,\Sigma)$ under joint constraints such as $\Sigma\mu = \mu$ has not received much attention. It can be viewed as a multivariate counterpart of the classical estimation problem in the $N(\theta,\theta^2)$ distribution. In addition to the usual inference challenges under such non-linear constraints among the parameters (curved exponential family), one has to deal with the basic requirements of symmetry and positive definiteness when estimating a covariance matrix. We derive the non-linear likelihood equations for the constrained maximum likelihood estimator of $(\mu,\Sigma)$ and solve them using iterative methods. Generally, the MLE of covariance matrices computed using iterative methods do not satisfy the constraints. We propose a novel algorithm to modify such (infeasible) estimators or any other (reasonable) estimator. The key step is to re-align the mean vector along the eigenvectors of the covariance matrix using the idea of regression. In using the Lagrangian function for constrained MLE (Aitchison et al. 1958), the Lagrange multiplier entangles with the parameters of interest and presents another computational challenge. We handle this by either iterative or explicit calculation of the Lagrange multiplier. The existence and nature of location of the constrained MLE are explored within a data-dependent convex set using recent results from random matrix theory. A simulation study illustrates our methodology and shows that the modified estimators perform better than the initial estimators from the iterative methods.

A Constrained Maximum Likelihood Estimation for Skew Normal Mixtures

On mean and/or variance mixtures of normal distributions

Estimation and confidence sets for sparse normal mixtures

Maximal skewness projections for scale mixtures of skew-normal vectors

Bias-Corrected Estimators of Scalar Skew Normal

Mean mixtures of normal distributions: properties, inference and application

On cross-validated estimation of skew normal model

Estimation and Influence Diagnostics for the Multivariate Linear Regression Models with Skew Scale Mixtures of Normal Distributions

Finite mixture of regression models for censored data based on the skew-t distribution

A novel finite mixture model based on the generalized scale mixtures of asymmetric generalized normal distributions: properties, estimation methodology and applications

Scale mixtures of multivariate centered skew-normal distributions

Penalized Maximum Likelihood Estimator for Mixture of von Mises-Fisher Distributions

Asymptotic Properties of Nonparametric M-Estimation for Mixing Functional Data

A mixture of a normal distribution with random mean and variance -- Examples of inconsistency of maximum likelihood estimates

Approximate Inferences for Nonlinear Mixed Effects Models with Scale Mixtures of Skew-Normal Distributions

MLE of Jointly Constrained Mean-Covariance of Multivariate Normal Distributions

Numerical characteristics and parameter estimation of finite mixed generalized normal distribution

Parsimony and parameter estimation for mixtures of multivariate leptokurtic-normal distributions

On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models

Convergence rates for estimating multivariate scale mixtures of uniform densities

Exploring mixture estimators in stratified random sampling