Abstract:Univariate and multivariate general linear regression models, subject to linear inequality constraints, arise in many scientific applications. The linear inequality restrictions on model parameters are often available from phenomenological knowledge and motivated by machine learning applications of high-consequence engineering systems (Agrell, 2019; Veiga and Marrel, 2012). Some studies on the multiple linear models consider known linear combinations of the regression coefficient parameters restricted between upper and lower bounds. In the present paper, we consider both univariate and multivariate general linear models subjected to this kind of linear restrictions. So far, research on univariate cases based on Bayesian methods is all under the condition that the coefficient matrix of the linear restrictions is a square matrix of full rank. This condition is not, however, always feasible. Another difficulty arises at the estimation step by implementing the Gibbs algorithm, which exhibits, in most cases, slow convergence. This paper presents a Bayesian method to estimate the regression parameters when the matrix of the constraints providing the set of linear inequality restrictions undergoes no condition. For the multivariate case, our Bayesian method estimates the regression parameters when the number of the constrains is less than the number of the regression coefficients in each multiple linear models. We examine the efficiency of our Bayesian method through simulation studies for both univariate and multivariate regressions. After that, we illustrate that the convergence of our algorithm is relatively faster than the previous methods. Finally, we use our approach to analyze two real datasets.

Multiple linear regression with constrained coefficients: Application of the lagrange multiplier

Sparse Linear Regression with Constraints: A Flexible Entropy-based Framework

Structured Regularization In Barrier Nlp For Optimization Models With Dependent Constraints

The linearized alternating direction method of multipliers for low-rank and fused LASSO matrix regression model

Constrained Best Linear Unbiased Estimation

Envelopes for multivariate linear regression with linearly constrained coefficients

An Augmented Lagrangian Method for Non-Lipschitz Nonconvex Programming

Scaled sparse linear regression

Split Method of Multipliers and Its Application to Parallel and Distributed Logistic Regression

Estimation of the L2-Norm and Testing in Sparse Linear Regression with Unknown Variance

Predicting Accurate Lagrangian Multipliers for Mixed Integer Linear Programs

State Estimation with Nonlinear Inequality Constraints Based on Unscented Transformation

Learning solutions to some toy constrained optimization problems in infinite dimensional Hilbert spaces

Lag selection and estimation of stable parameters for multiple autoregressive processes through convex programming

A Sharper Computational Tool for L2E Regression

Asynchronous Distributed Method of Multipliers for Constrained Nonconvex Optimization

Restricted Ridge Regression estimator as a parameter estimation in multiple linear regression model for multicollinearity case

A constructive approach to L

Bayesian Estimation Approach for Linear Regression Models with Linear Inequality Restrictions

A Distributed Asynchronous Method of Multipliers for Constrained Nonconvex Optimization

Large covariance matrix estimation via penalized log-det heuristics