Abstract:Incremental learning is important for memory critical systems, especially when the growth of information technology has pushed the memory and storage costs to limits. Despite the great amount of effort researching into incremental classification paradigms and algorithms, the regression is given far less attention. In this paper, an incremental regression framework that is able to model the linear and nonlinear relationships between response variables and explanatory variables is proposed. A three layer feed-forward neural network structure is devised where the weights of the hidden layer are trained by topology learning neural networks. A Gaussian mixture weighted integrator is used to synthesize from the output of the hidden layer to give smoothed predictions. Two hidden layer parameters learning strategies whether by Growing Neural Gas (GNG) or the single layered Self-Organizing Incremental Neural Network (SOINN) are explored. The GNG strategy is more robust and flexible, and single layered SOINN strategy is less sensitive to parameter settings. Experiments are carried out on an artificial dataset and 6 UCI datasets. The artificial dataset experiments show that the proposed method is able to give predictions more smoothed than K-nearest-neighbor (KNN) and the regression tree. Comparing to the parametric method Support Vector Regression (SVR), the proposed method has significant advantage when learning on data with multi-models. Incremental methods including Passive and Aggressive regression, Online Sequential Extreme Learning Machine, Self-Organizing Maps and Incremental K-means are compared with the proposed method on the UCI datasets, and the results show that the proposed method outperforms them on most datasets.

Incremental learning of Gaussian mixture model: A top-down algorithm

A Gpu-Accelerated Approximate Algorithm for Incremental Learning of Gaussian Mixture Model

An Efficient Method for Incremental Learning of GMM Using CUDA

Adaptive Learning Algorithm Based on Mixture Gaussian Background

Gaussian Mixture Model Clustering with Incomplete Data

Gaussian Mixture Background Modeling Based On Cuda

A Greedy Merge Learning Algorithm for Gaussian Mixture Model

A BYY Scale-Incremental EM Algorithm for Gaussian Mixture Learning

A Gaussian Mixture Framework for Incremental Nonparametric Regression with Topology Learning Neural Networks

A Novel Incremental Gaussian Mixture Regression and Its Application for Time-varying Multimodal Process Quality Prediction

Recursive Gaussian Mixture Models for Adaptive Process Monitoring

Transfer-Learning-Based Gaussian Mixture Model for Distributed Clustering

Class-Incremental Mixture of Gaussians for Deep Continual Learning

Gaussian Mixture Reduction with Composite Transportation Divergence

Incremental Gaussian Mixture Model for Time-varying Process Monitoring

Towards a Moderate-Granularity Incremental Clustering Algorithm for GPU

ICGT: A Novel Incremental Clustering Approach Based on GMM Tree.

Gaussian mixture model training method based on genetic algorithms and fuzzy approach

A General Transfer Learning-based Gaussian Mixture Model for Clustering

A New Gaussian Mixture Model Optimization Method

Learning GMM Using Elliptically Contoured Distributions