Connecting geometric independent component analysis to unsupervised learning algorithms

F. J. Theis,C. G. Puntonet,P. Gruber,E. W. Lang,Ingenieria Informatica
2004-01-01
Abstract:The goal of independent component analysis (ICA) lies in transforming a mixed random vector in order to render it as independent as possible. This paper shows how to use adaptive learning and clustering al- gorithms to approximate mixture space densities thus learning the mixing model. Here, a linear square-model is assumed, and as learning algorithm either a self- organizing map (SOM) or a neural gas (NG) is used. These result in a considerable improvement in sepa- ration quality in comparison to other mixture-space analysis ('geometric') algorithms, although the com- putational cost is rather high. By establishing this connection between neural networks and ICA, applica- tions like for example transferring convergence proofs for SOMs to geometric ICA algorithms now seem pos- sible.
What problem does this paper attempt to address?