Abstract:In this paper, a sparse learning algorithm, probabilistic classification vector machines (PCVMs), is proposed. We analyze relevance vector machines (RVMs) for classification problems and observe that adopting the same prior for different classes may lead to unstable solutions. In order to tackle this problem, a signed and truncated Gaussian prior is adopted over every weight in PCVMs, where the sign of prior is determined by the class label, i.e., +1 or -1. The truncated Gaussian prior not only restricts the sign of weights but also leads to a sparse estimation of weight vectors, and thus controls the complexity of the model. In PCVMs, the kernel parameters can be optimized simultaneously within the training algorithm. The performance of PCVMs is extensively evaluated on four synthetic data sets and 13 benchmark data sets using three performance metrics, error rate (ERR), area under the curve of receiver operating characteristic (AUC), and root mean squared error (RMSE). We compare PCVMs with soft-margin support vector machines (SVM(Soft)), hard-margin support vector machines (SVM(Hard)), SVM with the kernel parameters optimized by PCVMs (SVM(PCVM)), relevance vector machines (RVMs), and some other baseline classifiers. Through five replications of twofold cross-validation F test, i.e., 5 x 2 cross-validation F test, over single data sets and Friedman test with the corresponding post-hoc test to compare these algorithms over multiple data sets, we notice that PCVMs outperform other algorithms, including SVM(Soft), SVM(Hard), RVM, and SVM(PCVM), on most of the data sets under the three metrics, especially under AUC. Our results also reveal that the performance of SVM(PCVM) is slightly better than SVM(Soft), implying that the parameter optimization algorithm in PCVMs is better than cross validation in terms of performance and computational complexity. In this paper, we also discuss the superiority of PCVMs' formulation using maximum a posteriori (MAP) analysis and margin analysis, which explain the empirical success of PCVMs.

Computing the Value at risk of Portfolios Using Modified Support Vector Machines

Support Vector Machines Ensemble With Optimizing Weights By Genetic Algorithm

M-estimator Based Support Vector Machine and Its Application

Portfolio selection under possibilistic mean-variance utility and a SMO algorithm

Portfolio Selection Based on Modified CoVaR in Gaussian Framework

Probabilistic Classification Vector Machines.

One Method of Application of Extreme Value Theory to Computing Value-at-Risk

Robust mean-risk portfolio optimization using machine learning-based trade-off parameter

Portfolio Risk Measurement Using a Mixture Simulation Approach

Support Vector Machine with Gauss Kernel Classified Method and Model Selection

Portfolio Rebalancing Model Utilizing Support Vector Machine for Optimal Asset Allocation

Weighted Posterior Probability Output for Support Vector Machines

A novel dual-weighted fuzzy proximal support vector machine with application to credit risk analysis

Support vector machines with the ε -insensitive pinball loss function for uncertain data classification

An uncertain support vector machine based on soft margin method

Portfolio Optimization with Nonparametric Value at Risk: A Block Coordinate Descent Method.

Portfolio optimization with CVaR under VG process

Fuzzy-Portfolio-Selection Models with Value-At-Risk

A novel dynamic risk assessment method for hazardous chemical warehouses based on improved SVM and mathematical methodologies

A Comparative Study of Relevant Vector Machine and Support Vector Machine in Uncertainty Analysis

Forecasting volatility with support vector machine-based GARCH model