Abstract:Abstract Motivation Advancements in high-throughput genomic sequencing are delivering genomic pathogen data at an unprecedented rate, positioning statistical phylogenetics as a critical tool to monitor infectious diseases globally. This rapid growth spurs the need for efficient inference techniques, such as Hamiltonian Monte Carlo (HMC) in a Bayesian framework, to estimate parameters of these phylogenetic models where the dimensions of the parameters increase with the number of sequences N. HMC requires repeated calculation of the gradient of the data log-likelihood with respect to (wrt) all branch-length-specific (BLS) parameters that traditionally takes O(N2) operations using the standard pruning algorithm. A recent study proposes an approach to calculate this gradient in O(N), enabling researchers to take advantage of gradient-based samplers such as HMC. The CPU implementation of this approach makes the calculation of the gradient computationally tractable for nucleotide-based models but falls short in performance for larger state-space size models, such as Markov-modulated and codon models. Here, we describe novel massively parallel algorithms to calculate the gradient of the log-likelihood wrt all BLS parameters that take advantage of graphics processing units (GPUs) and result in many fold higher speedups over previous CPU implementations. Results We benchmark these GPU algorithms on three computing systems using three evolutionary inference examples exploring complete genomes from 997 dengue viruses, 62 carnivore mitochondria and 49 yeasts, and observe a >128-fold speedup over the CPU implementation for codon-based models and >8-fold speedup for nucleotide-based models. As a practical demonstration, we also estimate the timing of the first introduction of West Nile virus into the continental Unites States under a codon model with a relaxed molecular clock from 104 full viral genomes, an inference task previously intractable. Availability and implementation We provide an implementation of our GPU algorithms in BEAGLE v4.0.0 (https://github.com/beagle-dev/beagle-lib), an open-source library for statistical phylogenetics that enables parallel calculations on multi-core CPUs and GPUs. We employ a BEAGLE-implementation using the Bayesian phylogenetics framework BEAST (https://github.com/beast-dev/beast-mcmc).

BATCH-SCAMPP: Batch Scaled Phylogenetic Placement Large Trees

EPA-ng: Massively Parallel Evolutionary Placement of Genetic Sequences

Evolutionary Placement of Short Sequence Reads

HAlign-II: Efficient Ultra-Large Multiple Sequence Alignment and Phylogenetic Tree Reconstruction with Distributed and Parallel Computing

OrthoPhyl – Streamlining large scale, orthology-based phylogenomic studies of bacteria at broad evolutionary scales

Reconstructing Evolutionary Trees in Parallel for Massive Sequences

HPTree: Reconstructing Phylogenetic Trees for Ultra-Large Unaligned DNA Sequences Via NJ Model and Hadoop

ClustalXeed: a GUI-based grid computation version for high performance and terabyte size multiple sequence alignment

DecentTree: scalable Neighbour-Joining for the genomic era

Scaling neighbor joining to one million taxa with dynamic and heuristic neighbor joining

Efficient comparative phylogenetics on large trees

Load balancing and parallel multiple sequence alignment with tree accumulation

Critical assessment of on-premise approaches to scalable genome analysis

Finding high posterior density phylogenies by systematically extending a directed acyclic graph

Many-core algorithms for high-dimensional gradients on phylogenetic trees

Sciphy: A Bayesian phylogenetic framework using sequential genetic lineage tracing data.

A format for phylogenetic placements

ParGenes: a tool for massively parallel model selection and phylogenetic tree inference on thousands of genes

Phylogeny Reconstruction with Alignment-Free Method That Corrects for Horizontal Gene Transfer

Extreme Scale De Novo Metagenome Assembly

Bayesian Phylogenetic Analysis on multi-core Compute Architectures: Implementation and evaluation of BEAGLE in RevBayes with MPI