Abstract:Bayesian estimation is a major and robust estimator for many advanced statistical models. Being able to incorporate prior knowledge in statistical inference, Bayesian methods have been successfully applied in many different fields such as business, computer science, economics, epidemiology, genetics, imaging, and political science. However, due to its high computational complexity, Bayesian estimation has been deemed difficult, if not impractical, for large-scale databases, stream data, data warehouses, and data in the cloud. In this paper, we propose a novel compression and aggregation schemes (C&A) that enables distributed, parallel, or incremental computation of Bayesian estimates. Assuming partitioning of a large dataset, the C&A scheme compresses each partition into a synopsis and aggregates the synopsis into an overall Bayesian estimate without accessing the raw data. Such a C&A scheme can find applications in OLAP for data cubes, stream data mining, and cloud computing. It saves tremendous computing time since it processes each partition only once, enabling fast incremental update, and allows parallel processing. We prove that the compression is asymptotically lossless in the sense that the aggregated estimator deviates from the true model by an error that is bounded and approaches to zero when the data size increases. The results show that the proposed C&A scheme can make feasible OLAP of Bayesian estimates in a data cube. Further, it supports real-time Bayesian analysis of stream data, which can only be scanned once and cannot be permanently retained. Experimental results validate our theoretical analysis and demonstrate that our method can dramatically save time and space costs with almost no degradation of the modeling accuracy.

Effective parameter space compression for Bayesian adaptive estimation

Can Global Optimization Strategy Outperform Myopic Strategy for Bayesian Parameter Estimation?

A flexible Bayesian method for adaptive measurement in psychophysics

Rate-Adaptive Bayesian Independent Component Analysis

Bayesian Compressed Regression

Accurate estimation of functional brain connectivity via Bayesian ICA with population-derived priors

Compression and Aggregation of Bayesian Estimates for Data Intensive Computing

1-Bit Compressive Diffusion in Networks Based on Bayesian Inference.

Ideal Bayesian Spatial Adaptation

Adaptively Robust Small Area Estimation: Balancing Robustness and Efficiency of Empirical Bayes Confidence Intervals

The Importance of Constraint Smoothness for Parameter Estimation in Computational Cognitive Modeling

A Method for Compressing Parameters in Bayesian Models with Application to Logistic Sequence Prediction Models

A Modified Extended Bayesian Method for Parameter Estimation

Range limited adaptive pulse compression via linear Bayes estimation

Efficient Model Compression for Bayesian Neural Networks

Optimal post-selection inference for sparse signals: a nonparametric empirical-Bayes approach

Hyperparameter Estimation for Sparse Bayesian Learning Models

A hierarchical Bayesian approach to adaptive vision testing: A case study with the contrast sensitivity function

Enhancing Scalability in Bayesian Nonparametric Factor Analysis of Spatiotemporal Data

Towards Practical Bayesian Parameter and State Estimation.