Abstract:In recent years, support vector regression (SVR) has become an emerging and popular forecasting technique in the field of machine learning. However, it is subjected to the model selection and learning complexity O(K* N-3), especially for a massive data set (N is the size of training dataset, and K is the number of search). How to simultaneously reduce K and N can give us insight and inspiration on designing an effective and accurate selection algorithm. To this end, this paper tries to integrate the selection of training subset and model for SVR, and proposes a nested particle swarm optimization (NPSO) by inheriting the model selection of the existing training subset based SVR (TS-SVR). This nested algorithm is achieved by adaptively and periodically estimating the search region of the optimal parameter setting for TS-SVR. Complex SVR, involving large-scale training data, can be seen as extensions of TS-SVRs, yielding a nested sequence of TS-SVRs with increasing sample size. The uniform design idea is transplanted to the above modeling process, and the convergence for the proposed model is proofed. By using two artificial regression problems, Boston housing and electric load in New South Wales as empirical data, the proposed approach is compared with the standard ones, the APSO-OTS-SVR, and other existing approaches. Empirical results show that the proposed approach not only can select proper training subset and parameter, but also has better generalization performance and fewer processing time. (C) 2017 Elsevier B.V. All rights reserved.

An improved ensemble learning method based on SVR

On-line support vector regression with multiple samples

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

An updating method for support vector learning

An On-Line Learning Approach with Support Vector Dormain Classifier

Improvement Classification Performance by the Support Vector Machine Ensemble

An Improved Way to Make Large-Scale SVR Learning Practical

Boosting Ensemble of Support Vector Regression for Landslide Prediction

A Novel SVM Ensemble Approach Using Clustering Analysis

Parameter choosing method of support vector regression for time series prediction

Support vector machine ensemble using rough sets theory

Bagging Support Vector Data Description Model for Batch Process Monitoring

A New Strategy of SVR Modeling Based on Clustering Algorithm

Support vector machine based ensemble classifier

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Clustering analysis application in SVM ensemble#

A Robust Semi-Supervised SVM Via Ensemble Learning

Empirical analysis of support vector machine ensemble classifiers

Sequence Targets Classification Algorithm Based on Ensemble Improvement SVM and Clustering Analysis

Rough Reducts Based Svm Ensemble

A Modified Support Vector Regression: Integrated Selection of Training Subset and Model.