Abstract:In this work we consider estimating the probability of many (possibly dependent) binary outcomes which is at the core of many applications, e.g., multi-level treatments in causal inference, demands for bundle of products, etc. Without further conditions, the probability distribution of an M dimensional binary vector is characterized by exponentially in M coefficients which can lead to a high-dimensional problem even without the presence of covariates. Understanding the (in)dependence structure allows us to substantially improve the estimation as it allows for an effective factorization of the probability distribution. In order to estimate the probability distribution of a M dimensional binary vector, we leverage a Bahadur representation that connects the sparsity of its coefficients with independence across the components. We propose to use regularized and adversarial regularized estimators to obtain an adaptive estimator with respect to the dependence structure which allows for rates of convergence to depend on this intrinsic (lower) dimension. These estimators are needed to handle several challenges within this setting, including estimating nuisance parameters, estimating covariates, and nonseparable moment conditions. Our main results consider the presence of (low dimensional) covariates for which we propose a locally penalized estimator. We provide pointwise rates of convergence addressing several issues in the theoretical analyses as we strive for making a computationally tractable formulation. We apply our results in the estimation of causal effects with multiple binary treatments and show how our estimators can improve the finite sample performance when compared with non-adaptive estimators that try to estimate all the probabilities directly. We also provide simulations that are consistent with our theoretical findings.

A robust likelihood approach to inference for paired multiple binary endpoints data

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

Multiple-model-based robust estimation of causal treatment effect on a binary outcome with integrated information from secondary outcomes

Robust statistical inference for the matched net benefit and the matched win ratio using prioritized composite endpoints

Double Robust Bayesian Inference on Average Treatment Effects

A Nonparametric Global Win Probability Approach to the Analysis and Sizing of Randomized Controlled Trials With Multiple Endpoints of Different Scales and Missing Data: Beyond O'Brien–Wei–Lachin

Modeling paired binary data by a new bivariate Bernoulli model with flexible beta kernel correlation

Bayesian joint analysis of heterogeneous- and skewed-longitudinal data and a binary outcome, with application to AIDS clinical studies

Joint Probability Estimation of Many Binary Outcomes via Localized Adversarial Lasso

Enhanced doubly robust estimation with concave link functions for estimands in clinical trials

Information Recovery in a Study with Surrogate Endpoints

Estimation of Causal Effects of Multiple Treatments in Observational Studies with a Binary Outcome

Bayesian Index Models for Heterogeneous Treatment Effects on a Binary Outcome

Optimal exact tests for multiple binary endpoints

Common odds ratio test and interval estimation for stratified bilateral and unilateral data

Robust adaptive LASSO in high-dimensional logistic regression

Use of copula to model within-study association in bivariate meta-analysis of binomial data at the aggregate level a Bayesian approach and application to surrogate endpoint evaluation

Bayesian propensity scores for high-dimensional causal inference: A comparison of drug-eluting to bare-metal coronary stents

Robust data integration from multiple external sources for generalized linear models with binary outcomes

Bayesian Multivariate Probability of Success Using Historical Data with Strict Control of Family-wise Error Rate

Homogeneity tests and interval estimations of risk differences for stratified bilateral and unilateral correlated data