On the Distribution of Feature Space in Self-Organising Mapping and Convergence Accelerating by a Kalman Algorithm

Hujun Yin,Nigel M. Allinson
DOI: https://doi.org/10.1007/3-540-56798-4_162
1993-01-01
Abstract:In this paper we present a detailed investigation of the statistical and convergence properties of the Kohonen's Self-Organising Mapping (SOM) in any dimension. Using an extend Central Limit Theorem, we prove that the feature space in SOM learning is an approximation to multiple Gausssian distributed stochastic processes, which will eventually converge in the meansquare sense to the density centres of the input probabilistic sub-spaces. We also demonstrate that combining the SOM with a Kalman filter can smooth and accelerate the learning and convergence of the SOM. In our applications, we show that such a modified SOM achieves a much better performance, namely a lower distortion than the original algorithm, especially in early training stages, and at low extra computational cost. This modification will be particular useful when the available training set is small.
What problem does this paper attempt to address?