Abstract:In multicenter research, individual-level data are often protected against sharing across sites. To overcome the barrier of data sharing, many distributed algorithms, which only require sharing aggregated information, have been developed. The existing distributed algorithms usually assume the data are homogeneously distributed across sites. This assumption ignores the important fact that the data collected at different sites may come from various sub-populations and environments, which can lead to heterogeneity in the distribution of the data. Ignoring the heterogeneity may lead to erroneous statistical inference. In this paper, we propose distributed algorithms which account for the heterogeneous distributions by allowing site-specific nuisance parameters. The proposed methods extend the surrogate likelihood approach to the heterogeneous setting by applying a novel density ratio tilting method to the efficient score function. The proposed algorithms maintain the same communication cost as the existing communication-efficient algorithms. We establish a non-asymptotic risk bound for the proposed distributed estimator and its limiting distribution in the two-index asymptotic setting which allows both sample size per site and the number of sites to go to infinity. In addition, we show that the asymptotic variance of the estimator attains the Cramér-Rao lower bound when the number of sites is in rate smaller than the sample size at each site. Finally, we use simulation studies and a real data application to demonstrate the validity and feasibility of the proposed methods.

Communication-Efficient Accurate Statistical Estimation

Distributed Bootstrap Simultaneous Inference for High-Dimensional Quantile Regression

A communication efficient distributed one-step estimation

One-Round Communication Efficient Distributed M-Estimation.

An Accelerated Distributed Method with Inexact Model of Relative Smoothness and Strong Convexity

Communication-efficient Estimation for Distributed Subset Selection

Quantized Distributed Estimation with Adaptive Combiner

Distributed Estimation with Empirical Likelihood

Communication-efficient distributed statistical inference

Communication-efficient distributed EM algorithm

Distributed Gaussian Mean Estimation under Communication Constraints: Optimal Rates and Communication-Efficient Algorithms

Statistical Estimation and Evaluation for Communication Mapping in Network-on-Chip

Communication-efficient Sparse Composite Quantile Regression for Distributed Data

Heterogeneity-aware and communication-efficient distributed statistical inference

Distributed Algorithms for U-statistics-based Empirical Risk Minimization

AIDE: Fast and Communication Efficient Distributed Optimization

Communication-Efficient Modeling with Penalized Quantile Regression for Distributed Data

An Efficient Distributed Nash Equilibrium Seeking with Compressed and Event-triggered Communication

Distributed Estimation and Inference for Semi-parametric Binary Response Models

Communication-Efficient Decentralized Cooperative Data Analytics in Sensor Networks.

Signal-Comparison-Based Distributed Estimation Under Decaying Average Bit Rate Communications