Abstract:Univariate and multivariate general linear regression models, subject to linear inequality constraints, arise in many scientific applications. The linear inequality restrictions on model parameters are often available from phenomenological knowledge and motivated by machine learning applications of high-consequence engineering systems (Agrell, 2019; Veiga and Marrel, 2012). Some studies on the multiple linear models consider known linear combinations of the regression coefficient parameters restricted between upper and lower bounds. In the present paper, we consider both univariate and multivariate general linear models subjected to this kind of linear restrictions. So far, research on univariate cases based on Bayesian methods is all under the condition that the coefficient matrix of the linear restrictions is a square matrix of full rank. This condition is not, however, always feasible. Another difficulty arises at the estimation step by implementing the Gibbs algorithm, which exhibits, in most cases, slow convergence. This paper presents a Bayesian method to estimate the regression parameters when the matrix of the constraints providing the set of linear inequality restrictions undergoes no condition. For the multivariate case, our Bayesian method estimates the regression parameters when the number of the constrains is less than the number of the regression coefficients in each multiple linear models. We examine the efficiency of our Bayesian method through simulation studies for both univariate and multivariate regressions. After that, we illustrate that the convergence of our algorithm is relatively faster than the previous methods. Finally, we use our approach to analyze two real datasets.

Linear Bayesian Estimators for Linear Models with Constraints

Bayes estimator for the inequality-constrained regression model*

Bayesian Estimation Approach for Linear Regression Models with Linear Inequality Restrictions

Variational Bayes Learning for Models with Linear Equality Constraints

Modeling and State Estimation for Dynamic Systems With Linear Equality Constraints

Constrained Best Linear Unbiased Estimation

Linear Minimum Mean Square Error Estimation For Linear Systems With Stochastic State Equality Constraints

Estimation and Filtering of Gaussian Variables with Linear Inequality Constraints

A Constrained Interval-Valued Linear Regression Model: A New Heteroscedasticity Estimation Method

Weighted and Partial Total Least Squares Method for the EIV Model with Linear Equality and Inequality Constraints

Sparse estimation of linear model via Bayesian method

The Superiority of Empirical Bayes Estimator of Parameters in Linear Model

Likelihood-based Multivariate Fuzzy Model with Linear Inequality Constraints

Superiority of Empirical Bayes Estimation of Error Variance in Linear Model

Approximate Solution and Convergence of Parameter Estimation of a Linear Model with Linear Inequality Constraints

Quality Evaluation of Linear Inequality Constrained Estimation by Monte Carlo Sampling in Parameter Space

On the Restricted Almost Unbiased Estimators in Linear Regression

The Superiority of Bayes Linear Unbiased Minimum Variance Estimator with Respect to Ridge Estimator

Bayesian Approach to Learn Bayesian Networks Using Data and Constraints.

A New Liu-type Estimator in Linear Regression Model

Linear Regression Analysis with Inequality Constraints on the Regression Parameters Via Empirical Likelihood