Abstract:Fusing probabilistic information is a fundamental task in signal and data processing with relevance to many fields of technology and science. In this work, we investigate the fusion of multiple probability density functions (pdfs) of a continuous random variable or vector. Although the case of continuous random variables and the problem of pdf fusion frequently arise in multisensor signal processing, statistical inference, and machine learning, a universally accepted method for pdf fusion does not exist. The diversity of approaches, perspectives, and solutions related to pdf fusion motivates a unified presentation of the theory and methodology of the field. We discuss three different approaches to fusing pdfs. In the axiomatic approach, the fusion rule is defined indirectly by a set of properties (axioms). In the optimization approach, it is the result of minimizing an objective function that involves an information-theoretic divergence or a distance measure. In the supra-Bayesian approach, the fusion center interprets the pdfs to be fused as random observations. Our work is partly a survey, reviewing in a structured and coherent fashion many of the concepts and methods that have been developed in the literature. In addition, we present new results for each of the three approaches. Our original contributions include new fusion rules, axioms, and axiomatic and optimization-based characterizations; a new formulation of supra-Bayesian fusion in terms of finite-dimensional parametrizations; and a study of supra-Bayesian fusion of posterior pdfs for linear Gaussian models.

Inverse Covariance Intersection Fusion of Multiple Estimates

Split Covariance Intersection with Correlated Components for Distributed Estimation

Enhanced Sequential Covariance Intersection Fusion

A Quarter Century of Covariance Intersection: Correlations Still Unknown?

Consistent fusion method with uncertainty elimination for distributed multi-sensor systems

On Error Cross-correlation and Fusion Algorithm for Multi-sensor Hybrid Multiple Model Estimation

Targeted Fused Ridge Estimation of Inverse Covariance Matrices from Multiple High-Dimensional Data Classes

Exploiting Structure for Optimal Multi-Agent Bayesian Decentralized Estimation

Data fusion using weakly aligned sources

Collaborative Estimation of Real Valued Function by Two Agents and a Fusion Center with Knowledge Exchange

Invited Commentary: Estimation and Bounds under Data Fusion

Calibrated regression estimation using empirical likelihood under data fusion

Fusion of Probability Density Functions

Towards a Unified Theory for Semiparametric Data Fusion with Individual-Level Data

Bayesian data fusion with shared priors

Inverse-Covariance-Intersection-Based Distributed Estimation and Application in Wireless Sensor Network

Entropic covariance models

Data-fusion using factor analysis and low-rank matrix completion

Estimation Fusion with General Asynchronous Multi-Rate Sensors

Identification and Estimation for Nonignorable Missing Data: A Data Fusion Approach

The joint graphical lasso for inverse covariance estimation across multiple classes