Abstract:In this article, our goal is to develop a method for Bayesian model averaging in linear regression models to accommodate heavier tailed error distributions than the normal distribution. Motivated by the use of the Huber loss function in presence of outliers, Park and Casella (2008) proposed the concept of the Bayesian Huberized lasso, which has been recently developed and implemented by Kawakami and Hashimoto (2023), with hyperbolic errors. Because the Huberized lasso cannot enforce regression coefficients to be exactly zero, we propose a fully Bayesian variable selection approach with spike and slab priors, that can address sparsity more effectively. Furthermore, while the hyperbolic distribution has heavier tails than a normal distribution, its tails are less heavy in comparison to a Cauchy <a class="link-external link-http" href="http://distribution.Thus" rel="external noopener nofollow">this http URL</a>, we propose a regression model, with an error distribution that encompasses both hyperbolic and Student-t distributions. Our model aims to capture the benefit of using Huber loss, but it can also adapt to heavier tails, and unknown levels of sparsity, as necessitated by the data. We develop an efficient Gibbs sampler with Metropolis Hastings steps for posterior computation. Through simulation studies, and analyses of the benchmark Boston housing dataset and NBA player salaries in the 2022-2023 season, we show that our method is competitive with various state-of-the-art methods.

Weighted-Average Least Squares for Negative Binomial Regression

Reweighted Nonnegative Least-Mean-Square Algorithm

A general averaging method for count data with overdispersion and/or excess zeros in biomedicine

Model Averaging for Estimating Treatment Effects With Binary Responses

A Scalable Frequentist Model Averaging Method

Accurate inference in negative binomial regression

Least Squares Model Averaging Based on Generalized Cross Validation

Model Averaging Procedure for Varying-Coefficient Partially Linear Models with Missing Responses

Alternating Direction Method of Multipliers for Negative Binomial Model with The Weighted Difference of Anisotropic and Isotropic Total Variation

Optimal Model Averaging Estimator for Multinomial Logit Models

Jackknife model averaging for linear regression models with missing responses

Model Averaging Estimation for Nonparametric Varying-Coefficient Models with Multiplicative Heteroscedasticity

Optimal model averaging for partially linear models with missing response variables and error‐prone covariates

Robust Bayesian Model Averaging for Linear Regression Models With Heavy-Tailed Errors

On Asymptotic Optimality of Least Squares Model Averaging When True Model Is Included

Least Squares Model Averaging by Mallows Criterion

A Model Averaging Approach for the Ordered Probit and Nested Logit Models with Applications

A minimalistic and general weighted averaging method for inconsistent data

WALS prediction

Optimal Model Averaging for Semiparametric Partially Linear Models with Censored Data

Unified Optimal Model Averaging with a General Loss Function Based on Cross-Validation