Abstract:We develop a nonparametric Bayesian modeling approach to ordinal regression based on priors placed directly on the discrete distribution of the ordinal responses. The prior probability models are built from a structured mixture of multinomial distributions. We leverage a continuation-ratio logits representation to formulate the mixture kernel, with mixture weights defined through the logit stick-breaking process that incorporates the covariates through a linear function. The implied regression functions for the response probabilities can be expressed as weighted sums of parametric regression functions, with covariate-dependent weights. Thus, the modeling approach achieves flexible ordinal regression relationships, avoiding linearity or additivity assumptions in the covariate effects. A key model feature is that the parameters for both the mixture kernel and the mixture weights can be associated with a continuation-ratio logits regression structure. Hence, an efficient and relatively easy to implement posterior simulation method can be designed, using P\'olya-Gamma data augmentation. Moreover, the model is built from a conditional independence structure for category-specific parameters, which results in additional computational efficiency gains through partial parallel sampling. In addition to the general mixture structure, we study simplified model versions that incorporate covariate dependence only in the mixture kernel parameters or only in the mixture weights. For all proposed models, we discuss approaches to prior specification and develop Markov chain Monte Carlo methods for posterior simulation. The methodology is illustrated with several synthetic and real data examples.

Multivariate probability distribution for categorical and ordinal random variables

Multivariate binary probability distribution in the Grassmann formalism

A mixture distribution for modelling bivariate ordinal data

Unimodal Distributions for Ordinal Regression

Multivariate Bernoulli distribution

A Generic Multivariate Distribution for Counting Data

Generating Multivariate Ordinal Data via Entropy Principles

Structured Mixture of Continuation-ratio Logits Models for Ordinal Regression

Multivariate ordinal regression for multiple repeated measurements

Bayesian mixture modeling for multivariate conditional distributions

Multivariate Categorical Data Distribution Estimation Based on Deep Gaussian Process

Multimatricvariate and multimatrix variate distributions based on elliptically contoured laws under real normed division algebras

Modelling correlated ordinal data by random-effects logistic regression models: simulation and application

Categorical Distributions of Maximum Entropy under Marginal Constraints

Probabilistic Missing Value Imputation for Mixed Categorical and Ordered Data

Scalable Estimation of Multinomial Response Models with Random Consideration Sets

Probability boxes on totally preordered spaces for multivariate modelling

The Aldous--Hoover Theorem in Categorical Probability

Covariance and PCA for Categorical Variables

Bivariate Distribution Regression with Application to Insurance Data

Bayesian factor models for multivariate categorical data obtained from questionnaires