Abstract:In multicenter research, individual-level data are often protected against sharing across sites. To overcome the barrier of data sharing, many distributed algorithms, which only require sharing aggregated information, have been developed. The existing distributed algorithms usually assume the data are homogeneously distributed across sites. This assumption ignores the important fact that the data collected at different sites may come from various sub-populations and environments, which can lead to heterogeneity in the distribution of the data. Ignoring the heterogeneity may lead to erroneous statistical inference. In this paper, we propose distributed algorithms which account for the heterogeneous distributions by allowing site-specific nuisance parameters. The proposed methods extend the surrogate likelihood approach to the heterogeneous setting by applying a novel density ratio tilting method to the efficient score function. The proposed algorithms maintain the same communication cost as the existing communication-efficient algorithms. We establish a non-asymptotic risk bound for the proposed distributed estimator and its limiting distribution in the two-index asymptotic setting which allows both sample size per site and the number of sites to go to infinity. In addition, we show that the asymptotic variance of the estimator attains the Cramér-Rao lower bound when the number of sites is in rate smaller than the sample size at each site. Finally, we use simulation studies and a real data application to demonstrate the validity and feasibility of the proposed methods.

Communication-efficient Estimation for Distributed Subset Selection

Minimax and Communication-Efficient Distributed Best Subset Selection with Oracle Property

Distributed Privacy-Aware Fast Selection Algorithm for Large-Scale Data.

A communication efficient distributed one-step estimation

Distributed Successive Measurement Selection Based on Online Sparsity Inference

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

Selective Inference with Distributed Data

Median Selection Subset Aggregation for Parallel Inference

Communication-Efficient Accurate Statistical Estimation

Multi-Slot Distributed Measurement Selection: A Sparsity Learning Approach

Optimal Sparsity-Sensitive Bounds for Distributed Mean Estimation.

Robust Covariance Estimation for Distributed Principal Component Analysis

Heterogeneity-aware and communication-efficient distributed statistical inference

Distributed Estimation and Inference for Semi-parametric Binary Response Models

Distributed Nonparametric Regression under Communication Constraints

Communication-efficient distributed EM algorithm

Distributed Sparse Total Least-Squares over Networks

Distributed Estimation for Principal Component Analysis: An Enlarged Eigenspace Analysis

Adaptive distributed methods under communication constraints

On Distributed Larger-Than-Memory Subset Selection With Pairwise Submodular Functions

Distributed Sparse Recursive Least-Squares over Networks