Abstract:Broad learning system (BLS), a novel incremental learning algorithm, has attracted more and more attention and application. BLS achieves a perfect balance between learning performance and modeling efficiency based on the mean square error (MSE) criterion. However, MSE assumes that a random error between an observed value and real value is a Gaussian distribution, which may be inconsistent to the real-world situation. Moreover, the distributional assumptions may cast doubt on the generalization and validity of the built BLS model. In this article, we propose a novel distribution-free BLS for regression analysis, called broad minimax probability learning system (BMPLS). Learning from the idea of minimax probability machine regression, BMPLS builds a regression model by maximizing the worst probability of the regression function being within the allowed error range. It adequately utilizes the mean and covariance information of the hidden-space feature without making any distributional assumptions of the random error. In order to further improve the learning performance of the model, a regularized BMPLS (RBMPLS) is proposed by applying elastic-net regularization term to BMPLS. The corresponding optimization algorithm is also designed for calculating the output weights of the model. Multiple experiments based on public datasets were carried out to demonstrate the feasibility of the proposed algorithms.

The Superiorities of Minimum Bayes Risk Linear Unbiased Estimator in Two Seemingly Unrelated Regressions 1

The Superiority of Bayes Linear Unbiased Minimum Variance Estimator with Respect to Ridge Estimator

The Superiorities of Bayes Linear Minimum Risk Estimation in Linear Model

The Superiority of the Bayes Linear Unbiased Minimum Variance Estimator under Balanced Loss Function

The Bayes Estimation of Parameters in Semi-Parametric Regression Model

Superiority of Empirical Bayes Estimator of the Mean Vector in Multivariate Normal Distribution

On the Restricted Almost Unbiased Estimators in Linear Regression

Mean Squared Error Matrix Comparisons of Some Restricted Almost Unbiased Estimators

Mini-Max-Risk and Mini-Mean-Risk Inferences for A Partially Piecewise Regression

Superiorities of Simultaneous Bayes Estimation of Regression Coefficients and Error-Variance in Linear Model

Superiority of Empirical Bayes Estimation of Error Variance in Linear Model

On the Liu estimation of Bell regression model in the presence of multicollinearity

The Robustness of Bayes Linear Unbiased Estimations under Misspecified Prior Assumption

More on the Bias and Variance Comparisons of the Restricted Almost Unbiased Estimators

Preliminary test almost unbiased ridge estimator in a linear regression model with multivariate Student-t errors

The Superiority of Empirical Bayes Estimator of Parameters in Linear Model

Unbiased Estimation of Weibull Parameters with the Linear Regression Method

Preliminary Test Two-Parameter Estimators Based on W, LR and LM Test-Statistics in a Regression Model

Broad Minimax Probability Learning System and its Application in Regression Modeling

On the Weighted Mixed Almost Unbiased Ridge Estimator in Stochastic Restricted Linear Regression

Large System Of Seemingly Unrelated Regressions: A Penalized Quasi-Maximum Likelihood Estimation Perspective