Abstract:To solve the modeling problem under the conditions where the measured data are insufficient but biased prior knowledge from a simulator is available, we propose a novel multi-scale \(\nu \)-linear programming support vector regression (\(\nu \)-LPSVR) called \(\nu \)-MPESVR. The proposed algorithm constructs a nested support vector regression model, which incorporates prior knowledge into \(\nu \)-LPSVR, compensates for the errors between prior knowledge data and the measured data, and simultaneously achieves small training error for both the prediction model and the error compensation model. Considering that measured data may exist in multiple feature spaces, we extend the algorithm to multi-scale \(\nu \)-LPSVR to achieve accurate modeling for complex problems. In addition, a strategy for parameter selection for \(\nu \)-MPESVR is presented in this paper. The performance of the proposed algorithm is estimated in a synthetic example and a practical application. The performances of all models are evaluated with the root mean square error (RMSE), mean absolute error (MAE), and coefficient of determination (R2). Taking the three groups of experiments in the synthetic example as an instance, we find that the \(\nu \)-MPESVR performs better, and it can still maintain high accuracy when the biases of prior knowledge data change (RMSE values of 0.1962, 0.1904, and 0.2261, MAE values of 0.1396, 0.1375, and 0.1623, and R2 values of 0.9919, 0.9923, and 0.9892 for the three groups of experiments, respectively). The experimental results indicate that the proposed algorithm can obtain a satisfactory model with a finite amount of measured data, and the performance is better than that of existing algorithms.

A Leave-One-Out Bound For V-Support Vector Regression

On-line support vector regression with multiple samples

LOO Bounds for Support Vector Machines

Flatheaded support vector machine for regression

Average case analysis of Lasso under ultra-sparse conditions

Rough Ν-Support Vector Regression

An Unbalanced Dataset Classification Approach Based On V-Support Vector Machine

L1-Norm Least Squares Support Vector Regression Via the Alternating Direction Method of Multipliers

A Novel Support Vector Regression Algorithm Incorporated with Prior Knowledge and Error Compensation for Small Datasets

Noise model based ν-support vector regression with its application to short-term wind speed forecasting

Mini-batch Quasi-Newton Optimization for Large Scale Linear Support Vector Regression

Multiscale Support Vector Regression Method in Sobolev Spaces on Bounded Domains

A fast and robust model selection algorithm for multi-input multi-output support vector machine

Robust Sparse Least Squares Support Vector Regression Machine Based on Decremental Learning

Uncertain least square support vector regression with imprecise observations

Approximate Leave-one-out Cross Validation for Regression with $\ell_1$ Regularizers (extended version)

Online Kernel Learning with a Near Optimal Sparsity Bound

Robust LS-SVR Based on Variational Bayesian and Its Applications

Improving Sparsity and Scalability in Regularized Nonconvex Truncated-Loss Learning Problems

Theoretical Analysis of Leave-one-out Cross Validation for Non-differentiable Penalties under High-dimensional Settings

A Novel Support Vector Regression for Data Set with Outliers.