Abstract:Statistical inference in high-dimensional settings is challenging when standard unregularized methods are employed. In this work, we focus on the case of multiple correlated proportions for which we develop a Bayesian inference framework. For this purpose, we construct an $m$-dimensional Beta distribution from a $2^m$-dimensional Dirichlet distribution, building on work by Olkin and Trikalinos (2015). This readily leads to a multivariate Beta-binomial model for which simple update rules from the common Dirichlet-multinomial model can be adopted. From the frequentist perspective, this approach amounts to adding pseudo-observations to the data and allows a joint shrinkage estimation of mean vector and covariance matrix. For higher dimensions ($m > 10$), the extensive model based on $2^m$ parameters starts to become numerically infeasible. To counter this problem, we utilize a reduced parametrisation which has only $1 + m(m + 1)/2$ parameters describing first and second order moments. A copula model can then be used to approximate the (posterior) multivariate Beta distribution. A natural inference goal is the construction of multivariate credible regions. The properties of different credible regions are assessed in a simulation study in the context of investigating the accuracy of multiple binary classifiers. It is shown that the extensive and copula approach lead to a (Bayes) coverage probability very close to the target level. In this regard, they outperform credible regions based on a normal approximation of the posterior distribution, in particular for small sample sizes. Additionally, they always lead to credible regions which lie entirely in the parameter space which is not the case when the normal approximation is used.

Multinomial Restricted Unfolding

A Mixed Bayesian Network for Two-Dimensional Decision Modeling of Departure Time and Mode Choice

Class-Distributed Learning for Multinomial Logistic Regression with High Dimensional Features and a Large Number of Classes

Unfolding-Model-Based Visualization: Theory, Method and Applications

Multinomial Models with Linear Inequality Constraints: Overview and Improvements of Computational Methods for Bayesian Inference

Simultaneous Dimension Reduction and Variable Selection for Multinomial Logistic Regression

Supervised and Unsupervised Mapping of Binary Variables: A proximity perspective

Developments of Two Supervised Maximum Variance Unfolding Algorithms for Process Classification

Multinomial Logistic Regression: Asymptotic Normality on Null Covariates in High-Dimensions

Multivariate Bernoulli distribution

Estimating the Density Ratio between Distributions with High Discrepancy using Multinomial Logistic Regression

Logistic Multidimensional Data Analysis for Ordinal Response Variables using a Cumulative Link function

Structured Mixture of Continuation-ratio Logits Models for Ordinal Regression

Simultaneous Inference for Multiple Proportions: A Multivariate Beta-Binomial Model

A Novel Class of Unfolding Models for Binary Preference Data

Estimating the Multidimensional Generalized Graded Unfolding Model with Covariates Using a Bayesian Approach

Frequentist-Bayes Hybrid Covariance Estimationfor Unfolding Problems

The MELODIC family for simultaneous binary logistic regression in a reduced space

Logistic biplot for nominal data

A high‐dimensional multinomial logit model

Beyond unimodal regression: modelling multimodality with piecewise unimodal regression or deconvolution models