Abstract:In this manuscript, we study scalar-on-distribution regression; that is, instances where subject-specific distributions or densities are the covariates, related to a scalar outcome via a regression model. In practice, only repeated measures are observed from those covariate distributions and common approaches first use these to estimate subject-specific density functions, which are then used as covariates in standard scalar-on-function regression. We propose a simple and direct method for linear scalar-on-distribution regression that circumvents the intermediate step of estimating subject-specific covariate densities. We show that one can directly use the observed repeated measures as covariates and endow the regression function with a Gaussian process prior to obtain a closed form or conjugate Bayesian inference. Our method subsumes the standard Bayesian non-parametric regression using Gaussian processes as a special case, corresponding to covariates being Dirac-distributions. The model is also invariant to any transformation or ordering of the repeated measures. Theoretically, we show that, despite only using the observed repeated measures from the true density-valued covariates that generated the data, the method can achieve an optimal estimation error bound of the regression function. The theory extends beyond i.i.d. settings to accommodate certain forms of within-subject dependence among the repeated measures. To our knowledge, this is the first theoretical study on Bayesian regression using distribution-valued covariates. We propose numerous extensions including a scalable implementation using low-rank Gaussian processes and a generalization to non-linear scalar-on-distribution regression. Through simulation studies, we demonstrate that our method performs substantially better than approaches that require an intermediate density estimation step especially with a small number of repeated measures per subject. We apply our method to study association of age with activity counts.

A method for Bayesian regression modelling of composition data

Bayesian Regression for a Dirichlet Distributed Response using Stan

Spatial Autoregressive Model on a Dirichlet Distribution

A Bayesian Zero-Inflated Dirichlet-Multinomial Regression Model for Multivariate Compositional Count Data

Multimode process data modeling: A Dirichlet process mixture model based Bayesian robust factor analyzer approach

Bayesian compositional models for ordinal response

A simple Bayesian model to estimate proportions and ratios from count data with a hierarchical error structure with an application to droplet digital PCR experiments

Spatial Hyperspheric Models for Compositional Data

Bayesian Parameter Estimation for Biochemical Reaction Networks Using Region-Based Adaptive Parallel Tempering

Bayesian density regression for count data

Bayesian compositional regression with microbiome features via variational inference

Bayesian Variable Shrinkage and Selection in Compositional Data Regression: Application to Oral Microbiome

Functional Dirichlet Process.

Composition analysis based on Bayesian methods

Bayesian Multilevel Compositional Data Analysis: Introduction, Evaluation, and Application

Bayesian graphical compositional regression for microbiome data

Bayesian Geostatistical Modeling for Discrete-Valued Processes

Direct Bayesian linear regression for distribution-valued covariates

A probability for classification based on the mixture of Dirichlet process model

A Fully Nonparametric Modelling Approach to Binary Regression

Simultaneous Inference for Multiple Proportions: A Multivariate Beta-Binomial Model