Abstract:Maximum Likelihood (ML) estimation requires precise knowledge of the underlying statistical model. In Quasi ML (QML), a presumed model is used as a substitute to the (unknown) true model. In the context of Independent Vector Analysis (IVA), we consider the Gaussian QML Estimate (QMLE) of the demixing matrices set and present an (approximate) analysis of its asymptotic separation performance. In Gaussian QML the sources are presumed to be Gaussian, with covariance matrices specified by some "educated guess". The resulting quasi-likelihood equations of the demixing matrices take a special form, recently termed an extended "Sequentially Drilled" Joint Congruence (SeDJoCo) transformation, which is reminiscent of (though essentially different from) classical joint diagonalization. We show that asymptotically this QMLE, i.e., the solution of the resulting extended SeDJoCo transformation, attains perfect separation (under some mild conditions) regardless of the sources' true distributions and/or covariance matrices. In addition, based on the "small-errors" assumption, we present a first-order perturbation analysis of the extended SeDJoCo solution. Using the resulting closed-form expressions for the errors in the solution matrices, we provide closed-form expressions for the resulting Interference-to-Source Ratios (ISRs) for IVA. Moreover, we prove that asymptotically the ISRs depend only on the sources' covariances, and not on their specific distributions. As an immediate consequence of this result, we provide an asymptotically attainable lower bound on the resulting ISRs. We also present empirical results, corroborating our analytical derivations, of three simulation experiments concerning two possible model errors - inaccurate covariance matrices and sources' distribution mismodeling.

Spurious Solution of the Maximum Likelihood Approach to Ica

Local Separation Property Of The Two-Source Ica Problem With The One-Bit-Matching Condition

FastICA Algorithm Based on Maximum Likelihood Estimation and Bias Removal Technique

Analysis of feasible solutions of the ICA problem under the one-bit-matching condition

Performance Analysis of the Gaussian Quasi-Maximum Likelihood Approach for Independent Vector Analysis

A one-bit-matching learning algorithm for independent component analysis

An ICA Algorithm Based on Symmetric and Asymmetric Generalized Gaussian Model

One-Bit-Matching Conjecture for Independent Component Analysis

Novel algorithm for independent component analysis with flexible score functions

A Further Result on the ICA One-Bit-Matching Conjecture

MAXIMUM ENTROPY AND MINIMAL MUTUAL INFORMATION IN A NONLINEAR MODEL

Overcomplete ICA with a Geometric Algorithm

The Extended "Sequentially Drilled" Joint Congruence Transformation and its Application in Gaussian Independent Vector Analysis

An MRF-ICA based algorithm for image separation

Identifiability of overcomplete independent component analysis

A new algorithm of Infomax for small numbers of sound signal separation

Beyond Comon’s Identifiability Theorem for Independent Component Analysis

Improved post-nonlinear independent component analysis method based on Gaussian Mixture Model

Accelerating likelihood optimization for ICA on real signals

Study on the Indeterminacy of the Statistical Independence Based ICA Methods

A Novel ICA algorithm based on parameterized model