Abstract:This dissertation develops novel inferential methods and theory for assessing uncertainty of modern statistical procedures unique to big data analysis. In particular, we mainly focus on four challenging aspects of big data: massive sample size, high dimensionality, heterogeneity and complexity. To begin with, we consider a partially linear framework for modeling massive heterogeneous data. The major goal is to extract common features across all sub-populations while exploring heterogeneity of each sub-population. In particular, we propose an aggregation type estimator for the commonality parameter that possesses the (non-asymptotic) minimax optimal bound and asymptotic distribution as if there were no heterogeneity. This oracle result holds when the number of sub-populations does not grow too fast. The next problem focuses on the challenge of the high dimensionality. We propose a robust inferential procedure for assessing uncertainties of parameter estimation in high dimensional linear models, where the dimension p can grow exponentially fast with the sample size n. We develop a new de-biasing framework tailored for nonsmooth loss functions. Our framework enables us to exploit the composite quantile function to construct a de-biased CQR estimator. This estimator is robust, and preserves efficiency in the sense that the worst case efficiency loss is less than 30% compared to square-loss-based procedures. In many cases our estimator is close to or better than the latter. Next, we consider the problem of high dimensional semiparametric generalized linear models. We propose a new inferential framework which addresses a variety of challenging problems in high dimensional data analysis, including incomplete data, selection bias, and heterogeneity. First, we develop a regularized statistical chromatography approach to infer the parameter of interest under the proposed semiparametric generalized linear model without the need of estimating the unknown base measure function. Then we propose a new likelihood ratio based framework iii to construct post-regularization confidence regions and tests for the low dimensional components of high dimensional parameters. We demonstrate the consequences of the general theory by using examples of missing data and multiple datasets inference. Lastly, we study the rank likelihood as a powerful inferential tool in multivariate analysis. The computation of the full rank likelihood function is often intractable in large-scale datasets. Motivated by this, we resort to lower order rank approximations and propose a new family of local rank likelihood functions. In particular, we show that the maximizer of the second-order local rank likelihood coincides with the Kendall’s tau correlation matrix for the transelliptical distribution family. Motivated by this new interpretation of the Kendall’s tau, we then investigate the third-order local rank likelihood, whose maximizer defines a new estimator that can be viewed as the third-order counterpart of the Kendall’s tau correlation matrix. We establish asymptotic normality and calculate its limiting variance under the Gaussian copula model, which enables the construction of confidence intervals based on this new estimator.

Robust inference for the unification of confidence intervals in meta-analysis

Robust Estimation and Confidence Interval in Meta-Regression Models

A Unified Method for Improved Inference in Random-effects Meta-analysis

Robust inference methods for meta‐analysis involving influential outlying studies

A NEW PERSPECTIVE ON ROBUST M-ESTIMATION: FINITE SAMPLE THEORY AND APPLICATIONS TO DEPENDENCE-ADJUSTED MULTIPLE TESTING

A confidence interval robust to publication bias for random-effects meta-analysis of few studies

Confidence intervals for heterogeneity in meta-analysis of the rare binary events based on empirical likelihood-type methods

Robust Confidence Intervals for Meta-Regression with Interaction Effects

Exact inference for the random‐effect model for meta‐analyses with rare events

Jackknife empirical likelihood confidence intervals for assessing heterogeneity in meta-analysis of rare binary event data

Combining information from independent sources through confidence distributions

Random-Effect Meta-Analysis with Robust Between-Study Variance

Robust Point and Variance Estimation for Meta‐analyses with Selective Reporting and Dependent Effect Sizes

Statistical Inference for Big Data

A Monte Carlo Study of Confidence Interval Methods for Generalizability Coefficient.

Uncertainty Quantification and Confidence Intervals for Naive Rare-Event Estimators

Exploiting multivariate network meta-analysis: A calibrated Bayesian composite likelihood inference

Small sample adjustments for robust variance estimation with meta-regression.

Improved Confidence Regions in Meta-analysis of Diagnostic Test Accuracy

Likelihood-Free Frequentist Inference: Bridging Classical Statistics and Machine Learning for Reliable Simulator-Based Inference

Optimal testing using combined test statistics across independent studies