Abstract:The rapid growth in genomic pathogen data spurs the need for efficient inference techniques, such as Hamiltonian Monte Carlo (HMC) in a Bayesian framework, to estimate parameters of these phylogenetic models where the dimensions of the parameters increase with the number of sequences $N$. HMC requires repeated calculation of the gradient of the data log-likelihood with respect to (wrt) all branch-length-specific (BLS) parameters that traditionally takes $\mathcal{O}(N^2)$ operations using the standard pruning algorithm. A recent study proposes an approach to calculate this gradient in $\mathcal{O}(N)$, enabling researchers to take advantage of gradient-based samplers such as HMC. The CPU implementation of this approach makes the calculation of the gradient computationally tractable for nucleotide-based models but falls short in performance for larger state-space size models, such as codon models. Here, we describe novel massively parallel algorithms to calculate the gradient of the log-likelihood wrt all BLS parameters that take advantage of graphics processing units (GPUs) and result in many fold higher speedups over previous CPU implementations. We benchmark these GPU algorithms on three computing systems using three evolutionary inference examples: carnivores, dengue and yeast, and observe a greater than 128-fold speedup over the CPU implementation for codon-based models and greater than 8-fold speedup for nucleotide-based models. As a practical demonstration, we also estimate the timing of the first introduction of West Nile virus into the continental Unites States under a codon model with a relaxed molecular clock from 104 full viral genomes, an inference task previously intractable. We provide an implementation of our GPU algorithms in BEAGLE v4.0.0, an open source library for statistical phylogenetics that enables parallel calculations on multi-core CPUs and GPUs.

Faster computation of likelihood gradients for discrete observation Hidden Markov model

A tutorial of techniques for improving standard Hidden Markov Model algorithms

Differentiating Metropolis-Hastings to Optimize Intractable Densities

Learning Gaussian Mixtures Using the Wasserstein-Fisher-Rao Gradient Flow

Fast maximum likelihood estimation for general hierarchical models

Fast and Simple Optimization for Poisson Likelihood Models

Accelerated Information Gradient flow

Efficient MCMC for Gibbs Random Fields using pre-computation

On Efficient and Scalable Computation of the Nonparametric Maximum Likelihood Estimator in Mixture Models

Estimate exponential memory decay in hidden Markov model and its applications to inference

Fast likelihood evaluation using meshfree approximations for reconstructing compact binary sources

Near-Optimal MIMO Detection Using Gradient-Based MCMC in Discrete Spaces

Efficient, multimodal, and derivative-free Bayesian inference with Fisher-Rao gradient flows

Many-core algorithms for high-dimensional gradients on phylogenetic trees

Learning Hidden Markov Models Using Conditional Samples

A Concise Information-Theoretic Derivation of the Baum-Welch algorithm

An Efficient Em Approach To Parameter Learning Of The Mixture Of Gaussian Processes

Gradients do grow on trees: a linear-time ${\cal O}\hspace{-0.2em}\left( N \right)$-dimensional gradient for statistical phylogenetics

Learning in Gibbsian Fields: How Accurate and How Fast Can It Be?

On Convergence Properties of the EM Algorithm for Gaussian Mixtures.