Abstract:We develop a nonparametric Bayesian modeling approach to ordinal regression based on priors placed directly on the discrete distribution of the ordinal responses. The prior probability models are built from a structured mixture of multinomial distributions. We leverage a continuation-ratio logits representation to formulate the mixture kernel, with mixture weights defined through the logit stick-breaking process that incorporates the covariates through a linear function. The implied regression functions for the response probabilities can be expressed as weighted sums of parametric regression functions, with covariate-dependent weights. Thus, the modeling approach achieves flexible ordinal regression relationships, avoiding linearity or additivity assumptions in the covariate effects. A key model feature is that the parameters for both the mixture kernel and the mixture weights can be associated with a continuation-ratio logits regression structure. Hence, an efficient and relatively easy to implement posterior simulation method can be designed, using P\'olya-Gamma data augmentation. Moreover, the model is built from a conditional independence structure for category-specific parameters, which results in additional computational efficiency gains through partial parallel sampling. In addition to the general mixture structure, we study simplified model versions that incorporate covariate dependence only in the mixture kernel parameters or only in the mixture weights. For all proposed models, we discuss approaches to prior specification and develop Markov chain Monte Carlo methods for posterior simulation. The methodology is illustrated with several synthetic and real data examples.

A Mixture of logistic skew-normal Multinomial Models

Logistic Normal Multinomial Factor Analyzers for Clustering Microbiome Data

A Logistic Normal Multinomial Regression Model for Microbiome Compositional Data Analysis

Scalable Estimation and Regularization for the Logistic Normal Multinomial Model

A parsimonious family of multivariate Poisson-lognormal distributions for clustering multivariate count data

A Zero-Inflated Logistic Normal Multinomial Model for Extracting Microbial Compositions

Conditional regression based on a multivariate zero-inflated logistic normal model for microbiome relative abundance data

Cluster analysis of microbiome data by using mixtures of Dirichlet–multinomial regression models

Microbiome subcommunity learning with logistic-tree normal latent Dirichlet allocation

A Multivariate Poisson-Log Normal Mixture Model for Clustering Transcriptome Sequencing Data

A Bayesian Zero-Inflated Dirichlet-Multinomial Regression Model for Multivariate Compositional Count Data

A Marginalized Two-Part Beta Regression Model For Microbiome Compositional Data

Bayesian inference for finite mixtures of univariate and multivariate skew-normal and skew-t distributions

Bayesian Mixed Effects Models for Zero-inflated Compositions in Microbiome Data Analysis

Structured Mixture of Continuation-ratio Logits Models for Ordinal Regression

Modeling Sparse Data Using MLE with Applications to Microbiome Data

Variable selection for sparse Dirichlet-multinomial regression with an application to microbiome data analysis

A novel finite mixture model based on the generalized scale mixtures of asymmetric generalized normal distributions: properties, estimation methodology and applications

MZINBVA: Variational Approximation for Multilevel Zero-Inflated Negative-Binomial Models for Association Analysis in Microbiome Surveys

Bayesian Inference for Skew-Normal Nonlinear Reproductive Dispersion Mixed-Effect Models

Bayesian Nonparametric Ordination for the Analysis of Microbial Communities