Abstract:Univariate and multivariate general linear regression models, subject to linear inequality constraints, arise in many scientific applications. The linear inequality restrictions on model parameters are often available from phenomenological knowledge and motivated by machine learning applications of high-consequence engineering systems (Agrell, 2019; Veiga and Marrel, 2012). Some studies on the multiple linear models consider known linear combinations of the regression coefficient parameters restricted between upper and lower bounds. In the present paper, we consider both univariate and multivariate general linear models subjected to this kind of linear restrictions. So far, research on univariate cases based on Bayesian methods is all under the condition that the coefficient matrix of the linear restrictions is a square matrix of full rank. This condition is not, however, always feasible. Another difficulty arises at the estimation step by implementing the Gibbs algorithm, which exhibits, in most cases, slow convergence. This paper presents a Bayesian method to estimate the regression parameters when the matrix of the constraints providing the set of linear inequality restrictions undergoes no condition. For the multivariate case, our Bayesian method estimates the regression parameters when the number of the constrains is less than the number of the regression coefficients in each multiple linear models. We examine the efficiency of our Bayesian method through simulation studies for both univariate and multivariate regressions. After that, we illustrate that the convergence of our algorithm is relatively faster than the previous methods. Finally, we use our approach to analyze two real datasets.

Constrained estimation for the binomial AR(1) model: on Bayesian approach

Bayesian estimation for longitudinal data in a joint model with HPCs

Statistical inference for the binomial Ar(1) model with missing data

Bayesian Estimation Approach for Linear Regression Models with Linear Inequality Restrictions

Bayes estimator for the inequality-constrained regression model*

Complex-valued Bayesian parameter estimation via Markov chain Monte Carlo

Conditional L1 Estimation for Random Coefficient Integer-Valued Autoregressive Processes

Bayesian analysis for finite mixture in non-recursive non-linear structural equation models.

The Circumstance-Driven Bivariate Integer-Valued Autoregressive Model

Bayesian Grouping-Gibbs Sampling Estimation of High-dimensional Linear Model with Non-sparsity

Adding Constraints to Bayesian Inverse Problems.

Multinomial Models with Linear Inequality Constraints: Overview and Improvements of Computational Methods for Bayesian Inference

Binary and Ordinal Time Series with AR(p) Errors: Bayesian Model Determination for Latent High-Order Markov Process 1

Marginal Likelihood Estimation for the Negative Binomial INGARCH Model

Statistical inference for high dimensional regression via Constrained Lasso

A note on the estimation problem of dynamic binary panel data model with fixed effects

Incorporating Prior Knowledge of Latent Group Structure in Panel Data Models

Semiparametric Bayesian Analysis for Longitudinal Mixed Effects Models with Non-Normal AR(1) Errors

Constrained Testing and Estimation for Bayesian Joint Decision and Estimation.

A Binomial Integer-Valued ARCH Model

A novel Bayesian method for variable selection and estimation in binary quantile regression