Abstract:Data transformations are essential for broad applicability of parametric regression models. However, for Bayesian analysis, joint inference of the transformation and model parameters typically involves restrictive parametric transformations or nonparametric representations that are computationally inefficient and cumbersome for implementation and theoretical analysis, which limits their usability in practice. This article introduces a simple, general, and efficient strategy for joint posterior inference of an unknown transformation and all regression model parameters. The proposed approach directly targets the posterior distribution of the transformation by linking it with the marginal distributions of the independent and dependent variables, and then deploys a Bayesian nonparametric model via the Bayesian bootstrap. Crucially, this approach delivers (a) joint posterior consistency under general conditions, including multiple model misspecifications, and (b) efficient Monte Carlo (not Markov chain Monte Carlo) inference for the transformation and all parameters for important special cases. These tools apply across a variety of data domains, including real-valued, positive, and compactly-supported data. Simulation studies and an empirical application demonstrate the effectiveness and efficiency of this strategy for semiparametric Bayesian analysis with linear models, quantile regression, and Gaussian processes. The R package SeBR is available on CRAN. Supplementary materials for this article are available online, including a standardized description of the materials available for reproducing the work.

Statistical inference on transformation models: a self-induced smoothing approach

A Monte Carlo Method for Variance Estimation for Estimators Based on Induced Smoothing.

Semiparametric transformation Model with measurement error in Covariates: An Instrumental variable approach

Efficient Estimation in Single Index Models through Smoothing splines

A penalized likelihood approach for efficiently estimating a partially linear additive transformation model with current status data

FUSED KERNEL-SPLINE SMOOTHING FOR REPEATEDLY MEASURED OUTCOMES IN A GENERALIZED PARTIALLY LINEAR MODEL WITH FUNCTIONAL SINGLE INDEX

Efficient estimation of a linear transformation model for current status data via penalized splines

On Sparse Estimation for Semiparametric Linear Transformation Models

Semiparametric Transformation Models for Point Processes

Regression analysis of informative current status data with the semiparametric linear transformation model

On semiparametric transformation cure models

Semiparametric estimation of the transformation model by leveraging external aggregate data in the presence of population heterogeneity

SEMIPARAMETRIC TRANSFORMATION MODELS WITH MULTILEVEL RANDOM EFFECTS FOR CORRELATED DISEASE ONSET IN FAMILIES.

Monte Carlo Inference for Semiparametric Bayesian Regression

Statistical inference in functional semiparametric spatial autoregressive model

Statistical inference in the partial linear models with the inverse gaussian kernel

Non parametric regression models with additive distortions

Instrumental Variable Model Average With Applications in Nonlinear Causal Inference

Transformation Models in High Dimensions

Maximum likelihood estimation for semiparametric regression models with multivariate interval-censored data