Abstract:Motivation:Mathematical models have become standard tools for the investigation of cellular processes and the unraveling of signal processing mechanisms. The parameters of these models are usually derived from the available data using optimization and sampling methods. However, the efficiency of these methods is limited by the properties of the mathematical model, e.g. non-identifiabilities, and the resulting posterior distribution. In particular, multi-modal distributions with long valleys or pronounced tails are difficult to optimize and sample. Thus, the developement or improvement of optimization and sampling methods is subject to ongoing research.Results:We suggest a region-based adaptive parallel tempering algorithm which adapts to the problem-specific posterior distributions, i.e. modes and valleys. The algorithm combines several established algorithms to overcome their individual shortcomings and to improve sampling efficiency. We assessed its properties for established benchmark problems and two ordinary differential equation models of biochemical reaction networks. The proposed algorithm outperformed state-of-the-art methods in terms of calculation efficiency and mixing. Since the algorithm does not rely on a specific problem structure, but adapts to the posterior distribution, it is suitable for a variety of model classes.Availability and implementation:The code is available both as Supplementary Material and in a Git repository written in MATLAB.Supplementary information:Supplementary data are available at Bioinformatics online.

MapReduce for Bayesian Network Parameter Learning using the EM Algorithm

Scaling Bayesian Network Parameter Learning with Expectation Maximization using MapReduce

A Parallel Algorithm for Bayesian Network Parameter Learning Based on Factor Graph

Improving parameter learning of Bayesian nets from incomplete data

Efficient Algorithms for Bayesian Network Parameter Learning from Incomplete Data

Massively parallel learning of Bayesian networks with MapReduce for factor relationship analysis

Parallel EM Algorithm on Hadoop for Large-Scale Hidden Markov Model Parameter Estimation

Distributed Affinity Propagation Clustering Based on MapReduce

Bayesian Deep Learning Via Expectation Maximization and Turbo Deep Approximate Message Passing

Data-Intensive Learning Of Uncertain Knowledge

Bayesian Parameter Estimation for Biochemical Reaction Networks Using Region-Based Adaptive Parallel Tempering

Learning Bayesian Networks with Hidden Variables Using the Combination of EM and Evolutionary Algorithms

An automatic adaptive method to combine summary statistics in approximate Bayesian computation

The threshold EM algorithm for parameter learning in bayesian network with incomplete data

Data-Intensive Inferences Of Large-Scale Bayesian Networks

Efficient parameter learning for Bayesian Network classifiers following the Apache Spark Dataframes paradigm

Regularized EM algorithm for sparse parameter estimation in nonlinear dynamic systems with application to gene regulatory network inference

A Monte Carlo EM Algorithm for the Parameter Estimation of Aggregated Hawkes Processes

Big Learning Expectation Maximization

Missing Data Filling Algorithm for Big Data-Based Map-Reduce Technology

Learning Bayesian Networks From Data: An Efficient Approach Based On Extended Evolutionary Programming