Online Efficient Learning with Quantized KLMS and L<inf>1</inf> Regularization

Badong Chen,Songlin Zhao,Sohan Seth,José C. Prı́ncipe
DOI: https://doi.org/10.1109/ijcnn.2012.6252455
2012-01-01
Abstract:In a recent work, we have proposed the quantized kernel least mean square (QKLMS) algorithm, which is quite effective in online learning sequentially a nonlinear mapping with a slowly growing radial basis function (RBF) structure. In this paper, in order to further reduce the network size, we propose a sparse QKLMS algorithm, which is derived by adding a sparsity inducing l 1 norm penalty of the coefficients to the squared error cost. Simulation examples show that the new algorithm works efficiently, and results in a much sparser network while preserving a desirable performance.
What problem does this paper attempt to address?