Abstract:We develop a nonparametric Bayesian modeling approach to ordinal regression based on priors placed directly on the discrete distribution of the ordinal responses. The prior probability models are built from a structured mixture of multinomial distributions. We leverage a continuation-ratio logits representation to formulate the mixture kernel, with mixture weights defined through the logit stick-breaking process that incorporates the covariates through a linear function. The implied regression functions for the response probabilities can be expressed as weighted sums of parametric regression functions, with covariate-dependent weights. Thus, the modeling approach achieves flexible ordinal regression relationships, avoiding linearity or additivity assumptions in the covariate effects. A key model feature is that the parameters for both the mixture kernel and the mixture weights can be associated with a continuation-ratio logits regression structure. Hence, an efficient and relatively easy to implement posterior simulation method can be designed, using P\'olya-Gamma data augmentation. Moreover, the model is built from a conditional independence structure for category-specific parameters, which results in additional computational efficiency gains through partial parallel sampling. In addition to the general mixture structure, we study simplified model versions that incorporate covariate dependence only in the mixture kernel parameters or only in the mixture weights. For all proposed models, we discuss approaches to prior specification and develop Markov chain Monte Carlo methods for posterior simulation. The methodology is illustrated with several synthetic and real data examples.

Nonparametric maximum likelihood estimation under a likelihood ratio order

Mixture representations and Bayesian nonparametric inference for likelihood ratio ordered distributions

The Maximum Likelihood Estimation with the Order Statistics

Likelihood ratio test against simple stochastic ordering among several multinomial populations

Likelihood ratio ordering of order statistics

Inference on order restricted means of inverse Gaussian populations under heteroscedasticity

Estimating the Density Ratio between Distributions with High Discrepancy using Multinomial Logistic Regression

Online non-parametric likelihood-ratio estimation by Pearson-divergence functional minimization

Likelihood ratio order of sample minimum from heterogeneous Weibull random variables

Local Empirical Likelihood Inference for Varying-Coefficient Density-Ratio Models Based on Case-Control Data

Properties of maximum likelihood estimates of the ratio of parameters in ordinal response regression models

Multivariate Likelihood Ratio Orderings Between Spacings of Heterogeneous Exponential Random Variables

Likelihood Ratio Order of the Second Order Statistic from Independent Heterogeneous Exponential Random Variables

Structured Mixture of Continuation-ratio Logits Models for Ordinal Regression

Powerful Two-Sample Tests Based on the Likelihood Ratio.

Empirical Likelihood Inference and Goodness-of-fit Test for Logistic Regression Model under Two-Phase Case-Control Sampling

Comparison of empirical likelihood and its dual likelihood under density ratio model

LIKELIHOOD RATIO AND MEAN RESIDUAL LIFE ORDERS FOR ORDER STATISTICS OF HETEROGENEOUS RANDOM VARIABLES

Learning Likelihood Ratios with Neural Network Classifiers

An efficient asymptotic approach for testing monotone proportions assuming an underlying logit based order dose-response model