Boosting Ensemble of Support Vector Regression for Landslide Prediction

Hui DONG,He-lin FU,Wu-ming LENG,Wan-xue LONG
2007-01-01
Abstract:The regression results of the practically implemented support vector machines (SVR) are often far from the theoretically expected level because of the high complexity of time and space of real data, and it is difficult to practically select hyper-parameters for SVR. To improve the limited regression performance of the real SVR, a method was proposed to form committee machines for regression by using boosting techniques. In the process of algorithm, each sub SVR was trained independently and the training set was created based on weighted random sampling from the original dataset. The final SVR solution was produced by aggregating the sub SVRs results through methods such as least squares estimation based weighting etc. Experiments on both artificial and real-world datasets indicated that the Boosting ensemble SVR outperformed single SVR. In addition, the ensembles constructed were compared using boosting with those using bagging, and the results showed that boosting was generally much better.
What problem does this paper attempt to address?