Application and Study of Support Vector Regression Based on Optimization of Weighted Coefficient

CAO Yu-bo,YANG Ying,SHENG Ru-ji,CHEN Yan-qing

DOI: https://doi.org/10.3969/j.issn.1007-2853.2007.02.015

2007-01-01

Abstract:The optimization method of weighted coefficient of WSVR is studied.The analysis compared with the predicted data of stock market is presented.The analysis result shows that the prediction can be greatly improved through this method.

What problem does this paper attempt to address?

Weighted Support Vector Machines for Regression and Its Application

Shuxin Du

2004-01-01

Abstract:In the standard support vector machines for regression, the required error of regression estimation and the penalty for violation of the required error are equally considered for every training sample, which is unsuitable in case there exists significant difference among the training samples. In the proposed weighted support vector machines, each training sample had different approximation error requirement and different penalty. The dual quadratic optimization of weighted support vector machines for regression and its sequential minimal optimization (SMO) algorithms were given in detail. The experiments on the measurement of gasoline octane numbers by near-infrared spectroscopy, where the importance of each training sample was characterized by the geometrical distance from the test sample, show that the measurement accuracy is improved with the proposed weighted support vector machines.
Noise model based ν-support vector regression with its application to short-term wind speed forecasting

Qinghua Hu,Shiguang Zhang,Zongxia Xie,Jusheng Mi,Jie Wan

DOI: https://doi.org/10.1016/j.neunet.2014.05.003

Abstract:Support vector regression (SVR) techniques are aimed at discovering a linear or nonlinear structure hidden in sample data. Most existing regression techniques take the assumption that the error distribution is Gaussian. However, it was observed that the noise in some real-world applications, such as wind power forecasting and direction of the arrival estimation problem, does not satisfy Gaussian distribution, but a beta distribution, Laplacian distribution, or other models. In these cases the current regression techniques are not optimal. According to the Bayesian approach, we derive a general loss function and develop a technique of the uniform model of ν-support vector regression for the general noise model (N-SVR). The Augmented Lagrange Multiplier method is introduced to solve N-SVR. Numerical experiments on artificial data sets, UCI data and short-term wind speed prediction are conducted. The results show the effectiveness of the proposed technique.
Robust Iterative Algorithm of Weighted Least Squares Support Vector Machine and Its Application in Spectral Analysis

Bao Xin,Dai Liankui

DOI: https://doi.org/10.3321/j.issn:0567-7351.2009.10.008

2009-01-01

Acta Chimica Sinica

Abstract:A robust iterative algorithm of weighted least squares support vector machine (WLS-SVM) was proposed to overcome the negative influence of outliers on spectral analysis. A novel method to calculate regression error was proposed to solve the iterative convergence problem in original WLS-SVM; to improve the robustness of original WLS-SVM, the formula for computing weighted value was also revised: the median value of regression error was selected as criteria. This algorithm has been applied to spectral quantitative analysis. Compared with original algorithm, the experimental results show the proposed algorithm is convergent and the breakdown point value is approximately 35%.
Weighted Support Vector Regression Based on Weighting Factor Optimization

WANG Hao,WANG Xing-yu,NIU Yu-gang

DOI: https://doi.org/10.3969/j.issn.1006-9348.2006.07.031

2006-01-01

Abstract:The weighted support vector regression outperforms the standard support vector regression when applied in time sequence data set,for the merits that different input points can make different contributions to the learning of predictive function.In this paper,the selection problem of weighting factors in weighted support vector regression is considered.Based on the optimization technique,a new selecting approach is proposed to overcome the shortcoming of conventional methods.In the present method,a proper weighting factor is chosen as candidate weighting function being suited for suit certain time sequence data set.And then,a grid search approach is adopted to adaptively determine the suitable weighting factors.The experiment results show that the present method has a better performance than usual weighting factor selection method.
Weighted On-line Support Vector Regression

HUANG Xi-xia,SHI Fan-huai,GU Wei,CHEN Shan-ben

DOI: https://doi.org/10.3321/j.issn:1006-2467.2009.06.017

2009-01-01

Abstract:This paper investigated a weighted on-line support vector regression(WOSVR) approach based on the on-line support vector regression.In weighted support vector regression,the regularization parameter C is used variably with different samples,which denotes the different importance of the samples.In WOSVR,the importance of the recent past data is higher than that of the distant past data.Comparative tests were performed using chaotic Mackey-Glass benchmark.The experimental results show that the proposed method can change the model more effectively.
Application of Support Vector Machines Regression in Prediction Shanghai Stock Composite Index

Wang Dong,Wu Wen-feng

DOI: https://doi.org/10.1007/bf02903685

2003-01-01

Abstract:The SVMs for regression is used to forecast Shanghai stock composite index (SSCI). Implementing structural risk minimization principle, SVMs can overcome the over-fitting problem. The regression uses ɛ-insensitive loss function. The training of SVMs leads to a quadratic programming problem and it has a global unique solution. The experiment uses BP neural networks as benchmark for comparison. The results demonstrate that the prediction figure of SSCI can help to find timing for buy or sell, the forecasting variation of SVMs is smaller than that of BP, and the direction forecasting of SVMs is more accurate than that of BP.
Stock Prices Forecasting and Optimization Strategies Based on Support Vector Machines

Junyuan Qiu,Jiahao Xu,Zirui Yu

DOI: https://doi.org/10.54254/2754-1169/95/2024mur0089

2024-06-27

Abstract:With the global trend of digitization gaining prominence, the usage of machine learning methods such as Support Vector Machines and Reinforcement Learning for stock price prediction is becoming a hot topic. Over the past 40 years, China's economic market has undergone significant changes since the country's reform and opening up. In this study, the closing price and return of China's CSI 300 stock index are used as the database, and various data processing methods such as wavelet domain denoising, RSI screening and various SVM model optimization methods such as grid search and cross-validation are used to predict the upward or downward trend of stocks on the day after. The results of the study are presented by the model evaluation report and the heat map of the confusion matrix, which shows that the model prediction accuracy is 61% with the default parameters, and the accuracy improves to 67% after optimization. The results indicate that support vector machines are effective in stock price prediction, but there is still room for further improvement. This paper offers a potential approach that can increase return on investment and assist investors and financial institutions in making more informed investment decisions.
Improved V -Support Vector Regression Model Based on Variable Selection and Brain Storm Optimization for Stock Price Forecasting

Jianzhou Wang,Ru Hou,Chen Wang,Lin Shen

DOI: https://doi.org/10.1016/j.asoc.2016.07.024

IF: 8.7

2016-01-01

Applied Soft Computing

Abstract:Big data mining, analysis and forecasting always play a vital role in modern economic and industrial fields, and selecting an optimization model to improve time series' forecasting accuracy is challenging. A support vector regression (SVR) model is widely used forecasting and data processing, but the individual SVR cannot always satisfy the requirements of time series forecasting. In this paper, a hybrid v-SVR model is developed and combined with principal component analysis (PCA) and brain storm optimization (BSO) for stock price index forecasting. Correlation analysis and PCA are conducted initially to select the input variables of the v-SVR from 20 technical indicators, while the advanced BSO algorithm is used to search for optimal parameters of v-SVR. Case studies of the China Securities Index 300 (CSI300) and the Shenzhen Stock Exchange Component Index (SZSE Component Index) are examined as illustrative examples to evaluate the effectiveness and efficiency of the developed hybrid forecast strategy. Numerical results indicate that the developed hybrid model is not only simple but also able to satisfactorily approximate the actual CSI300stock price index, and it can be an effective tool in stock market mining and analysis. (C) 2016 Elsevier B.V. All rights reserved.
A New Weighted Support Vector Machine for Regression and Its Parameters Optimization

Liquan Mei,Shujuan Zhang

DOI: https://doi.org/10.1007/978-3-540-85984-0_72

2008-01-01

Abstract:In this paper what we study is twofold. Firstly a new weighted support vector machine(WSVM) is introduced, in which different roles of samples are considered. It better processes the singularity in the sample than SVM. Secondly based on grid search and the solution path algorithm, a new algorithm is given to quickly find the optimum parameters. Numerical results show the effectiveness and the stability of the algorithm.
Study On Optimization Of Support Vectors

Cg Wu,Lm Wan,Hp Lee,Yc Liang

DOI: https://doi.org/10.1109/ICMLC.2003.1259805

2003-01-01

Abstract:A novel method on the reduction of support vectors in the Support Vector Machine (SVM) is presented. The reduced support vectors in the SVM are applied to the agent initial position optimization of the land combat simulation model. Numerical simulations show that the running efficiency could be increased more then 370 times employing the proposed method compared with that. using the conventional SVM method under the original precision. Some experiences and trends in the study on the optimization problem are also summarized and presented.
Wind speed prediction using reduced support vector machines with feature selection

Xiaobing Kong,Xiangjie Liu,Ruifeng Shi,Kwang Y. Lee

DOI: https://doi.org/10.1016/j.neucom.2014.09.090

IF: 6

2015-12-01

Neurocomputing

Abstract:Accurate prediction of wind speed is one of the most effective ways to solve the problems of relaibility, security, stability and quality, which are caused by wind energy production in power systems. This paper presents a wind speed prediction concept with high efficiency convex optimization support vector machine for data regression (SVR). Based on the SVR, a reduced support vector machine (RSVM) is proposed, which preselects a subset of data as support vectors and solves a smaller optimization problem. The principal component analysis is utilized to determine the outcome of the major factors affecting the wind speed. With increasing number of the input variables in RSVM for regression structure, particle swarm optimization (PSO) is incorporated to optimize the parameters. Detailed analysis and simulations using the real time wind power plant data demonstrate the effectiveness of the RSVM-based forecasting approach.

computer science, artificial intelligence
A WOA-based Algorithm for Parameter Optimization of Support Vector Regression and Its Application to Condition Prognostics

Li Sai,Fang Huajing

DOI: https://doi.org/10.23919/chicc.2017.8028516

2017-01-01

Abstract:Condition monitoring is very important for system safety and condition-based maintenance. Time series prediction capabilities of machine learning like support vector regression (SVR) can be utilized for prognostics. But, choosing optimal parameters for SVR is an important step in SVR model design, which heavily affects the performance of SVR. So, a whale optimization algorithm (WOA) based algorithm is proposed for SVR parameters selection. The proposed algorithm has been evaluated through some benchmark datasets. Furthermore, the proposed method with moving window technology is used to condition prognostics of the Tennessee Eastman process. Experiments and engineering application show that the SVR-WOA method is effective, by noting that the computation time is shortened in some application scenarios.
Dynamic Simulation of Stock Market Based on SVM With Different Parameter Optimization Methods

Wen Chen,Yixiang Tian

DOI: https://doi.org/10.1007/978-981-10-2920-2_12

2017-01-01

Abstract:Stock market prediction has become an important research topic in recent years, but forecasting of such financial time series still remain a big challenge to financial engineering field because stock index is a non-linear, non-stationary time series. Based on support vector regression for forecasting the daily return of the stock index, this paper is devoted to find more improved forecasting models, in which model parameters are optimized through different methods in a sliding time window. The results of simulation experiments using historical data confirm the respective advantages of the forecasting models.
Working Paper: Improved Stock Price Forecasting Algorithm based on Feature-weighed Support Vector Regression by using Grey Correlation Degree

Quanxi Wang

DOI: https://doi.org/10.48550/arXiv.1902.08938

2019-02-24

Abstract:With the widespread engineering applications ranging from artificial intelligence and big data decision-making, originally a lot of tedious financial data processing, processing and analysis have become more and more convenient and effective. This paper aims to improve the accuracy of stock price forecasting. It improves the support vector machine regression algorithm by using grey correlation analysis (GCA) and improves the accuracy of stock prediction. This article first divides the factors affecting the stock price movement into behavioral factors and technical factors. The behavioral factors mainly include weather indicators and emotional indicators. The technical factors mainly include the daily closing data and the HS 300 Index, and then measure relation through the method of grey correlation analysis. The relationship between the stock price and its impact factors during the trading day, and this relationship is transformed into the characteristic weight of each impact factor. The weight of the impact factors of all trading days is weighted by the feature weight, and finally the support vector regression (SVR) is used. The forecast of the revised stock trading data was compared based on the forecast results of technical indicators (MSE, MAE, SCC, and DS) and unmodified transaction data, and it was found that the forecast results were significantly improved.

Computational Finance,Statistical Finance
Short-Term Wind Speed Forecasting Using Support Vector Regression Optimized by Cuckoo Optimization Algorithm

Jianzhou Wang,Qingping Zhou,Haiyan Jiang,Ru Hou

DOI: https://doi.org/10.1155/2015/619178

IF: 1.43

2015-01-01

Mathematical Problems in Engineering

Abstract:This paper develops an effectively intelligent model to forecast short-term wind speed series. A hybrid forecasting technique is proposed based on recurrence plot (RP) and optimized support vector regression (SVR). Wind caused by the interaction of meteorological systems makes itself extremely unsteady and difficult to forecast. To understand the wind system, the wind speed series is analyzed using RP. Then, the SVR model is employed to forecast wind speed, in which the input variables are selected by RP, and two crucial parameters, including the penalties factor and gamma of the kernel function RBF, are optimized by various optimization algorithms. Those optimized algorithms are genetic algorithm (GA), particle swarm optimization algorithm (PSO), and cuckoo optimization algorithm (COA). Finally, the optimized SVR models, including COA-SVR, PSO-SVR, and GA-SVR, are evaluated based on some criteria and a hypothesis test. The experimental results show that (1) analysis of RP reveals that wind speed has short-term predictability on a short-term time scale, (2) the performance of the COA-SVR model is superior to that of the PSO-SVR and GA-SVR methods, especially for the jumping samplings, and (3) the COA-SVR method is statistically robust in multi-step-ahead prediction and can be applied to practical wind farm applications.
Server Load Prediction Based on Wavelet Packet and Support Vector Regression

ShuPing Yao,Changzhen Hu,Wu Peng

DOI: https://doi.org/10.1109/ICCIAS.2006.295417

2007-01-01

Abstract:Wavelet packet theory and support vector regression (SVR) were introduced into server load prediction. A novel prediction algorithm called wavelet packet-SVR was proposed. Firstly, the algorithm decomposed and reconstructed the load time series into several signal branches by wavelet packet analysis. Secondly, SVR prediction models were constructed respectively to these branches and finally their predicted results were combined into final load value. Theory analysis and experiments show that wavelet packet transform is the extension of wavelet theory and has better frequency resolution. So it can decompose the original load series into several time series that have simpler frequency components and are easier to be forecasted; support vector regression has greater generation ability and guarantees global minima for given training data, it performs well for non-stationary time series prediction. So the proposed method is superior to wavelet based approach
Stock intelligent investment strategy based on support vector machine parameter optimization algorithm

Xuetao Li,Yi Sun

DOI: https://doi.org/10.1007/s00521-019-04566-2

2019-10-23

Neural Computing and Applications

Abstract:The changes in China's stock market are inseparable from the country's economic development and macroeconomic regulation and control and have far-reaching significance in promoting China's national economic growth. Compared with the Western developed capital market, China's current stock market's main smart investment strategy still has certain defects. Based on the SVM model, this paper establishes a predictive model that combines kernel parameters and parameter optimization to model. The mesh search method, genetic algorithm, and particle swarm optimization algorithm are used to optimize the parameters of the SVM under various kernel functions such as radial basis kernel function. The algorithm and particle swarm optimization algorithm optimize the parameters of the SVM to strengthen the applicability of the model in practice. The empirical results show that under the three-parameter optimization algorithms, the prediction results are higher than the random prediction accuracy, which indicates that it is effective to optimize the model by adjusting the parameters of the SVM. Among them, the SVM using the genetic algorithm parameter optimization under the radial basis kernel function shows the better prediction effect, which is the closest to the real value in the stock market forecast. The particle swarm algorithm supports the vector machine to predict the effect is slightly lower than the grid. Search method. In addition, through comparison experiments, the guess accuracy of BP neural network is worse than that of the support vector machine model before the adjustment. Finally, this paper uses the well-trained model to plan the stock smart investment plan.

computer science, artificial intelligence
Cross-Sectional Stock Return Analysis Using Support Vector Regression

Jie Liu,Zaixia Hu,Shaohua Tan

DOI: https://doi.org/10.1080/13504850701719777

2008-01-01

Applied Economics Letters

Abstract:We adopt epsilon-Support Vector Regression, a nonlinear regression method, to analyse the relationship between stock return and explanatory factors. Computational results show epsilon-SVR outperforms significantly the Ordinary Least Squares linear regression with a much higher R2 and a lower standard error.
Application of Support Vector Machine on the Prediction of Stock Market

Gang Yan

2008-01-01

Abstract:The regression problem,support vector machine and the research condition of the prediction of stock market is introduced.And then,a method for predicting stock based on SVM was proposed.The method was proved effective by a experiment.
Electromagnetic Relay Suction Prediction Based on Improved Support Vector Regression

Yingzhu Han,Huimin Liang,Duanlin Jiang,Zitong Wei,Jiaxin You,Guofu Zhai

DOI: https://doi.org/10.1109/cieec60922.2024.10583733

2024-01-01

Abstract:Support vector regression (SVR), a machine learning method based on statistical learning theory, is an effective tool for sample training and data prediction. However, limited by its own principles and mechanisms, SVR often needs to adjust internal parameters when facing outliers and special experimental data in the data, and its accuracy and stability will be reduced. The model optimization of SVR by subjecting the data to outlier detection can improve the model performance. On this basis, this paper proposes a Grey Wolf Optimization (GWO) Support Vector Regression (SVR) algorithm based on isolation - based anomaly detection using Nearest - Neighbor Ensembles (iNNE). Firstly, outlier detection is carried out using the iNNE method, where the raw data are processed and outliers are removed; secondly, an improved kernel function is proposed to better map the input vectors from the low-dimensional space to the high-dimensional feature space; thirdly, parameter optimization of the SVR model is carried out by using the GWO algorithm to obtain the optimal parameters, and lastly, prediction is carried out on the electromagnetic relay suction dataset as an example, and is achieved by comparing the results with those of the un-optimized SVR, the traditional outlier detection method and the SVR before improving the kernel function are tested by comparing with the unoptimized SVR, the traditional outlier detection method and the SVR before improving the kernel function. The results show that the proposed method can effectively improve the computation speed and prediction accuracy.

Application and Study of Support Vector Regression Based on Optimization of Weighted Coefficient

Weighted Support Vector Machines for Regression and Its Application

Noise model based ν-support vector regression with its application to short-term wind speed forecasting

Robust Iterative Algorithm of Weighted Least Squares Support Vector Machine and Its Application in Spectral Analysis

Weighted Support Vector Regression Based on Weighting Factor Optimization

Weighted On-line Support Vector Regression

Application of Support Vector Machines Regression in Prediction Shanghai Stock Composite Index

Stock Prices Forecasting and Optimization Strategies Based on Support Vector Machines

Improved V -Support Vector Regression Model Based on Variable Selection and Brain Storm Optimization for Stock Price Forecasting

A New Weighted Support Vector Machine for Regression and Its Parameters Optimization

Study On Optimization Of Support Vectors

Wind speed prediction using reduced support vector machines with feature selection

A WOA-based Algorithm for Parameter Optimization of Support Vector Regression and Its Application to Condition Prognostics

Dynamic Simulation of Stock Market Based on SVM With Different Parameter Optimization Methods

Working Paper: Improved Stock Price Forecasting Algorithm based on Feature-weighed Support Vector Regression by using Grey Correlation Degree

Short-Term Wind Speed Forecasting Using Support Vector Regression Optimized by Cuckoo Optimization Algorithm

Server Load Prediction Based on Wavelet Packet and Support Vector Regression

Stock intelligent investment strategy based on support vector machine parameter optimization algorithm

Cross-Sectional Stock Return Analysis Using Support Vector Regression

Application of Support Vector Machine on the Prediction of Stock Market

Electromagnetic Relay Suction Prediction Based on Improved Support Vector Regression