Abstract:In recent years, support vector regression (SVR) has become an emerging and popular forecasting technique in the field of machine learning. However, it is subjected to the model selection and learning complexity O(K* N-3), especially for a massive data set (N is the size of training dataset, and K is the number of search). How to simultaneously reduce K and N can give us insight and inspiration on designing an effective and accurate selection algorithm. To this end, this paper tries to integrate the selection of training subset and model for SVR, and proposes a nested particle swarm optimization (NPSO) by inheriting the model selection of the existing training subset based SVR (TS-SVR). This nested algorithm is achieved by adaptively and periodically estimating the search region of the optimal parameter setting for TS-SVR. Complex SVR, involving large-scale training data, can be seen as extensions of TS-SVRs, yielding a nested sequence of TS-SVRs with increasing sample size. The uniform design idea is transplanted to the above modeling process, and the convergence for the proposed model is proofed. By using two artificial regression problems, Boston housing and electric load in New South Wales as empirical data, the proposed approach is compared with the standard ones, the APSO-OTS-SVR, and other existing approaches. Empirical results show that the proposed approach not only can select proper training subset and parameter, but also has better generalization performance and fewer processing time. (C) 2017 Elsevier B.V. All rights reserved.

An Improved Way to Make Large-Scale SVR Learning Practical

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

An updating method for support vector learning

An On-Line Learning Approach with Support Vector Dormain Classifier

Support Vector Pursuit Learning

Simplified SMO Algorithm for Support Vector Regression

Simplify decision function of reduced support vector machines

Network Optimization Strategy of Support Vector Regression

A New Method to Construct Reduced Vector Sets for Simplifying Support Vector Machines

Stochastic Sequential Minimal Optimization For Large-Scale Linear Svm

An Improved Reduced Support Vector Machine

A Safe Screening Based Framework for Support Vector Regression.

Large-scale Support Vector Regression with Budgeted Stochastic Gradient Descent

Using Novel Support Vector Machines for Efficient Classification

A Learning and Classification Scheme of Large Training Set SVM Basd on NN-SRM Analysis

An Improved Robust and Sparse Twin Support Vector Regression Via Linear Programming

A Modified Support Vector Regression: Integrated Selection of Training Subset and Model.

Selecting A Reduced Set For Building Sparse Support Vector Regression In The Primal

An Improved LSSVM Regression Algorithm

An improved ensemble learning method based on SVR

The Research and Application of a Learning Algorithm of Batch Increment and Online Which Bases on Support Vector Regression