Abstract:To solve the modeling problem under the conditions where the measured data are insufficient but biased prior knowledge from a simulator is available, we propose a novel multi-scale \(\nu \)-linear programming support vector regression (\(\nu \)-LPSVR) called \(\nu \)-MPESVR. The proposed algorithm constructs a nested support vector regression model, which incorporates prior knowledge into \(\nu \)-LPSVR, compensates for the errors between prior knowledge data and the measured data, and simultaneously achieves small training error for both the prediction model and the error compensation model. Considering that measured data may exist in multiple feature spaces, we extend the algorithm to multi-scale \(\nu \)-LPSVR to achieve accurate modeling for complex problems. In addition, a strategy for parameter selection for \(\nu \)-MPESVR is presented in this paper. The performance of the proposed algorithm is estimated in a synthetic example and a practical application. The performances of all models are evaluated with the root mean square error (RMSE), mean absolute error (MAE), and coefficient of determination (R2). Taking the three groups of experiments in the synthetic example as an instance, we find that the \(\nu \)-MPESVR performs better, and it can still maintain high accuracy when the biases of prior knowledge data change (RMSE values of 0.1962, 0.1904, and 0.2261, MAE values of 0.1396, 0.1375, and 0.1623, and R2 values of 0.9919, 0.9923, and 0.9892 for the three groups of experiments, respectively). The experimental results indicate that the proposed algorithm can obtain a satisfactory model with a finite amount of measured data, and the performance is better than that of existing algorithms.

Multiscale Support Vector Regression Method in Sobolev Spaces on Bounded Domains

On-line support vector regression with multiple samples

A Novel Robust Smooth Support Vector Machine

Multiscale Support Vector Approach for Solving Ill-Posed Problems

MMSVC: an Efficient Unsupervised Learning Approach for Large-Scale Datasets.

Noise model based ν-support vector regression with its application to short-term wind speed forecasting

L1-Norm Least Squares Support Vector Regression Via the Alternating Direction Method of Multipliers

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

A Novel Support Vector Regression Algorithm Incorporated with Prior Knowledge and Error Compensation for Small Datasets

Modeling method of least squares support vector regression based on vector base learning

Sparse Least Squares Support Vector Machine for Function Estimation

Multi-output least-squares support vector regression machines

Interval regression analysis using support vector networks

A sparse semismooth Newton based augmented Lagrangian method for large-scale support vector machines

Least Squares Support Vector Machine Based on Scaling Kernel Function

An Improved Way to Make Large-Scale SVR Learning Practical

New method for solving Ivanov regularization-based support vector machine learning

Multi-scale support vector machine for regression estimation

Multiscale Analysis for Ill-Posed Problems with Semi-Discrete Tikhonov Regularization

Block-quantized support vector ordinal regression.

Convex Support Vector Regression