Abstract:The algorithms required for phylogenetics -- multiple sequence alignment and phylogeny estimation -- are both compute intensive. As the size of DNA sequence datasets continues to increase, there is a need for a tool that can effectively lessen the computational burden associated with this widely used analysis. 'diverse-seq' implements computationally efficient alignment-free algorithms that enable efficient prototyping for phylogenetic workflows. It can accelerate parameter selection searches for sequence alignment and phylogeny estimation by identifying a subset of sequences that are representative of the diversity in a collection. We show that selecting representative sequences with an entropy measure of $k$-mer frequencies correspond well to sampling via conventional genetic distances. The computational performance is linear with respect to the number of sequences and can be run in parallel. Applied to a collection of 10.5k whole microbial genomes on a laptop took ~8 minutes to prepare the data and 4 minutes to select 100 representatives. 'diverse-seq' can further boost the performance of phylogenetic estimation by providing a seed phylogeny that can be further refined by a more sophisticated algorithm. For ~1k whole microbial genomes on a laptop, it takes ~1.8 minutes to estimate a bifurcating tree from mash distances. The 'diverse-seq' algorithms are not limited to homologous sequences. As such, they can improve the performance of other workflows. For instance, machine learning projects that involve non-homologous sequences can benefit as representative sampling can mitigate biases from imbalanced groups. 'diverse-seq' is a BSD-3 licensed Python package that provides both a command-line interface and 'cogent3' plugins. The latter simplifies integration by users into their own analyses. It is available via the Python Package Index and GitHub.

Modelling phylogeny in 16S rRNA gene sequencing datasets using string kernels

Estimating Genome-wide Phylogenies Using Probabilistic Topic Modeling

diverse-seq: an application for alignment-free selecting and clustering biological sequences

Towards a Taxonomical Consensus: Diversity and Richness Inference from Large Scale rRNA gene Analysis

Modelling Microbiome Association with Host Phenotypes Using a Bayesian Dirichlet Process Model

OrthoPhyl – Streamlining large scale, orthology-based phylogenomic studies of bacteria at broad evolutionary scales

Modelling ecological communities as if they were DNA

Whole Proteome Prokaryote Phylogeny Without Sequence Alignment: A K-String Composition Approach

PhyloPythiaS+: A self-training method for the rapid reconstruction of low-ranking taxonomic bins from metagenomes

Linking phenotypic and genotypic variation: a relaxed phylogenetic approach using the probabilistic programming language Stan

Bayesian Inference of Pathogen Phylogeography using the Structured Coalescent Model

PhyloString: A web server designed to identify, visualize, and evaluate functional relationships between orthologous protein groups across different phylogenetic lineages

K-mer Natural Vector and Its Application to the Phylogenetic Analysis of Genetic Sequences.

Bayesian inference of phylogenetic distances: revisiting the eigenvalue approach

VBCG: 20 validated bacterial core genes for phylogenomic analysis with high fidelity and resolution

RNA-based Phylogenetic Methods: Application to Mammalian Mitochondrial RNA Sequences

A Bayesian approach to inferring the phylogenetic structure of communities from metagenomic data

Co-Phylog: an Assembly-Free Phylogenomic Approach for Closely Related Organisms

Bayesian identification of bacterial strains from sequencing data

Ocean to Tree: Leveraging Single-Molecule RNA-Seq to Repair Genome Gene Models and Improve Phylogenomic Analysis of Gene and Species Evolution

Evaluation of 16S rRNA gene sequencing for species and strain-level microbiome analysis