Abstract:In recent years, support vector regression (SVR) has become an emerging and popular forecasting technique in the field of machine learning. However, it is subjected to the model selection and learning complexity O(K* N-3), especially for a massive data set (N is the size of training dataset, and K is the number of search). How to simultaneously reduce K and N can give us insight and inspiration on designing an effective and accurate selection algorithm. To this end, this paper tries to integrate the selection of training subset and model for SVR, and proposes a nested particle swarm optimization (NPSO) by inheriting the model selection of the existing training subset based SVR (TS-SVR). This nested algorithm is achieved by adaptively and periodically estimating the search region of the optimal parameter setting for TS-SVR. Complex SVR, involving large-scale training data, can be seen as extensions of TS-SVRs, yielding a nested sequence of TS-SVRs with increasing sample size. The uniform design idea is transplanted to the above modeling process, and the convergence for the proposed model is proofed. By using two artificial regression problems, Boston housing and electric load in New South Wales as empirical data, the proposed approach is compared with the standard ones, the APSO-OTS-SVR, and other existing approaches. Empirical results show that the proposed approach not only can select proper training subset and parameter, but also has better generalization performance and fewer processing time. (C) 2017 Elsevier B.V. All rights reserved.

Hybrid Selection of Parameters for Support Vector Regression

Feature Selection and Parameter Optimization for Support Vector Machines: A New Approach Based on Genetic Algorithm with Feature Chromosomes.

Parameter Selection of Support Vector Regression Based on Hybrid Optimization Algorithm and Its Application

Novel Linear Search for Support Vector Machine Parameter Selection

SVM KERNEL PARAMETER SELECTION BASED ON IMPROVED GSO

Clonal selection algorithm based on feature antibodies for feature selection and parameter optimization of support vector machines

Parameters Selection of Support Vector Regression by Genetic Algorithms

Joint Optimization of Feature Selection and Parameters for Support Vector Regression

Hybrid optimization method for parameter selection of support vector machine

Hyper Parameters Selection For Svr Based On Steady-State Genetic Algorithm

Parameter Selection for Support Vector Machines Based on Hybrid Genetic Algorithms

Optimization of Support Vector Regression Parameters by Flower Pollination Algorithm

Parameter choosing method of support vector regression for time series prediction

SVR Kernel Parameters Selection Based on Steady-State Genetic Algorithm

Hybrid optimization of feature selection and SVM training model

Parameter Selection of Support Vector Regression Based on a Novel Chaotic Immune Algorithm

Parameters Optimization of Support Vector Regression Based on Immune Particle Swarm Optimization Algorithm

A Modified Support Vector Regression: Integrated Selection of Training Subset and Model.

Parameters Selection in Gene Selection Using Gaussian Kernel Support Vector Machines by Genetic Algorithm

Heuristic Algorithm for Tuning Hyperparameters in Support Vector Regression

An Experimental Comparison Of Genetic Algorithms For Optimizing Support Vector Regression In Grid Resources Prediction