Abstract:Statistical inference in high-dimensional settings is challenging when standard unregularized methods are employed. In this work, we focus on the case of multiple correlated proportions for which we develop a Bayesian inference framework. For this purpose, we construct an $m$-dimensional Beta distribution from a $2^m$-dimensional Dirichlet distribution, building on work by Olkin and Trikalinos (2015). This readily leads to a multivariate Beta-binomial model for which simple update rules from the common Dirichlet-multinomial model can be adopted. From the frequentist perspective, this approach amounts to adding pseudo-observations to the data and allows a joint shrinkage estimation of mean vector and covariance matrix. For higher dimensions ($m > 10$), the extensive model based on $2^m$ parameters starts to become numerically infeasible. To counter this problem, we utilize a reduced parametrisation which has only $1 + m(m + 1)/2$ parameters describing first and second order moments. A copula model can then be used to approximate the (posterior) multivariate Beta distribution. A natural inference goal is the construction of multivariate credible regions. The properties of different credible regions are assessed in a simulation study in the context of investigating the accuracy of multiple binary classifiers. It is shown that the extensive and copula approach lead to a (Bayes) coverage probability very close to the target level. In this regard, they outperform credible regions based on a normal approximation of the posterior distribution, in particular for small sample sizes. Additionally, they always lead to credible regions which lie entirely in the parameter space which is not the case when the normal approximation is used.

Multiple solutions to the likelihood equations in the Behrens-Fisher problem

Bose-Einstein condensation processes with nontrivial geometric multiplicites realized via ${\cal PT}-$symmetric and exactly solvable linear-Bose-Hubbard building blocks

Likelihood ratio tests under model misspecification in high dimensions

Likelihood-Based Tests on Moderate-High-Dimensional Mean Vectors with Unequal Covariance Matrices

Likelihood-based Tests on Linear Hypotheses of Large Dimensional Mean Vectors with Unequal Covariance Matrices

A test for k sample Behrens-Fisher problem in high dimensional data

Multiple Testing with Heterogeneous Multinomial Distributions

A likelihood ratio test for circular multimodality

A robust test approach for equality of mean vectors of two independent groups under the multivariate Behrens-Fisher problem

Penalized Maximum Likelihood Estimator for Mixture of von Mises-Fisher Distributions

Likelihood Correspondence of Statistical Models

Testing the Order of Multivariate Normal Mixture Models

Simultaneous Inference for Multiple Proportions: A Multivariate Beta-Binomial Model

Computationally efficient likelihood inference in exponential families when the maximum likelihood estimator does not exist

On Controlling the False Discovery Rate in Multiple Testing of the Means of Correlated Normals Against Two-Sided Alternatives

Are minimizers of the Onsager-Machlup functional strong posterior modes?

Consistent estimation of the proportion of false nulls and FDR for adaptive multiple testing Normal means under weak dependence

Multiple testing using uniform filtering of ordered p-values

On divergences tests for composite hypotheses under composite likelihood

Towards a theory for testing statistical hypothesis: Multivariate mean with nuisance covariance matrix

Likelihood ratio tests in random graph models with increasing dimensions