Abstract:In this article, our goal is to develop a method for Bayesian model averaging in linear regression models to accommodate heavier tailed error distributions than the normal distribution. Motivated by the use of the Huber loss function in presence of outliers, Park and Casella (2008) proposed the concept of the Bayesian Huberized lasso, which has been recently developed and implemented by Kawakami and Hashimoto (2023), with hyperbolic errors. Because the Huberized lasso cannot enforce regression coefficients to be exactly zero, we propose a fully Bayesian variable selection approach with spike and slab priors, that can address sparsity more effectively. Furthermore, while the hyperbolic distribution has heavier tails than a normal distribution, its tails are less heavy in comparison to a Cauchy <a class="link-external link-http" href="http://distribution.Thus" rel="external noopener nofollow">this http URL</a>, we propose a regression model, with an error distribution that encompasses both hyperbolic and Student-t distributions. Our model aims to capture the benefit of using Huber loss, but it can also adapt to heavier tails, and unknown levels of sparsity, as necessitated by the data. We develop an efficient Gibbs sampler with Metropolis Hastings steps for posterior computation. Through simulation studies, and analyses of the benchmark Boston housing dataset and NBA player salaries in the 2022-2023 season, we show that our method is competitive with various state-of-the-art methods.

A Short Note on the Efficiency of Markov Chains for Bayesian Linear Regression Models with Heavy-Tailed Errors

A Short Note on the Efficiency of Markov Chains for Bayesian Linear Regression Models with Heavy-Tailed Errors

A Short Note on the Geometric Ergodicity of Markov Chains for Bayesian Linear Regression Models with Heavy-Tailed Errors

Convergence Analysis of MCMC Algorithms for Bayesian Multivariate Linear Regression with Non‐Gaussian Errors

Log-regularly varying scale mixture of normals for robust regression

Geometric ergodicity of Gibbs samplers for Bayesian error-in-variable regression

Robust Bayesian Model Averaging for Linear Regression Models With Heavy-Tailed Errors

Robust Bayesian model selection for heavy-tailed linear regression using finite mixtures

Flexible Bayesian quantile regression for nonlinear mixed effects models based on the generalized asymmetric Laplace distribution

A general Bayesian model for heteroskedastic data with fully conjugate full-conditional distributions

Geometric ergodicity of trans-dimensional Markov chain Monte Carlo algorithms

Multivariate regular variation of heavy-tailed Markov chains

POSTERIOR ANALYSIS OF THE MULTIPLICATIVE HETEROSCEDASTICITY MODEL

Posterior Robustness with Milder Conditions: Contamination Models Revisited

Bayesian Variance Changepoint Detection in Linear Models with Symmetric Heavy-Tailed Errors

A non-asymptotic error analysis for parallel Monte Carlo estimation from many short Markov chains

Minimaxity under half-Cauchy type priors

Bayesian analysis of linear regression models with autoregressive symmetrical errors and incomplete data

Convergence analysis of data augmentation algorithms for Bayesian robust multivariate linear regression with incomplete data

A New Family of Error Distributions for Bayesian Quantile Regression

Optimal approximating Markov chains for Bayesian inference