Abstract:We derive lower bounds on the Bayes risk in decentralized estimation, where the estimator does not have direct access to the random samples generated conditionally on the random parameter of interest, but only to the data received from local processors that observe the samples. The received data are subject to communication constraints, due to quantization and the noise in the communication channels from the processors to the estimator. We first derive general lower bounds on the Bayes risk using information-theoretic quantities, such as mutual information, information density, small ball probability, and differential entropy. We then apply these lower bounds to the decentralized case, using strong data processing inequalities to quantify the contraction of information due to communication constraints. We treat the cases of a single processor and of multiple processors, where the samples observed by different processors may be conditionally dependent given the parameter, for noninteractive and interactive communication protocols. Our results recover and improve recent lower bounds on the Bayes risk and the minimax risk for certain decentralized estimation problems, where previously only conditionally independent sample sets and noiseless channels have been considered. Moreover, our results provide a general way to quantify the degradation of estimation performance caused by distributing resources to multiple processors, which is only discussed for specific examples in existing works.

$L_q$ Lower Bounds on Distributed Estimation via Fisher Information

Lower Bounds for Learning Distributions under Communication Constraints via Fisher Information

Restricted $Q$-Isometry Properties Adapted to Frames for Nonconvex $L_q$-Analysis

Information Lower Bounds for Robust Mean Estimation

A Lower Bound on the Fidelity Between Two States in Terms of Their Bures Distance

Berry Curvature As a Lower Bound for Multiparameter Estimation

Mutual Information Bounded by Fisher Information

Lower Bounds In Parameter Estimation Based On Quantized Measurements

Fisher information under local differential privacy

On Lower Bounds for Statistical Learning Theory

Quantum Fisher information and symmetric logarithmic derivative via anti-commutators

Sparse Estimation Via ℓ_q Optimization Method in High-Dimensional Linear Regression

Fisher Information and Spin Squeezing in the Lipkin-Meshkov-Glick Model

Sparse Estimation Via Lower-Order Penalty Optimization Methods in High-Dimensional Linear Regression.

Information-Theoretic Lower Bounds on Bayes Risk in Decentralized Estimation

On the Fundamental Limit of Distributed Learning with Interchangable Constrained Statistics

Quantized Distributed Estimation with Adaptive Combiner

Robust estimation of the Quantum Fisher Information on a quantum processor

Number of bits returned by a quantum estimation

Unified Cramér-Rao bound for quantum multi-parameter estimation: Invertible and non-invertible Fisher information matrix

Valid lower bound for all estimators in quantum parameter estimation