Abstract:The cost of DNA sequencing has dropped exponentially over the past decade, making genomic data accessible to a growing number of scientists. In bioinformatics, localization of short DNA sequences (reads) within large genomic sequences is commonly facilitated by constructing index data structures which allow for efficient querying of substrings. Recent metagenomic classification pipelines annotate reads with taxonomic labels by analyzing their $k$-mer histograms with respect to a reference genome database. CPU-based index construction is often performed in a preprocessing phase due to the relatively high cost of building irregular data structures such as hash maps. However, the rapidly growing amount of available reference genomes establishes the need for index construction and querying at interactive speeds. In this paper, we introduce MetaCache-GPU -- an ultra-fast metagenomic short read classifier specifically tailored to fit the characteristics of CUDA-enabled accelerators. Our approach employs a novel hash table variant featuring efficient minhash fingerprinting of reads for locality-sensitive hashing and their rapid insertion using warp-aggregated operations. Our performance evaluation shows that MetaCache-GPU is able to build large reference databases in a matter of seconds, enabling instantaneous operability, while popular CPU-based tools such as Kraken2 require over an hour for index construction on the same data. In the context of an ever-growing number of reference genomes, MetaCache-GPU is the first metagenomic classifier that makes analysis pipelines with on-demand composition of large-scale reference genome sets practical. The source code is publicly available at <a class="link-external link-https" href="https://github.com/muellan/metacache" rel="external noopener nofollow">this https URL</a> .

Accelerating K-mer Frequency Counting with GPU and Non-Volatile Memory

TopKmer: Parallel High Frequency K-mer Counting on Distributed Memory

Disaggregating Non-Volatile Memory for Throughput-Oriented Genomics Workloads

High-Performance Sorting-Based k-mer Counting in Distributed Memory with Flexible Hybrid Parallelism

MSPKmerCounter: A Fast and Memory Efficient Approach for K-mer Counting

Gerbil: A Fast and Memory-Efficient $k$-mer Counter with GPU-Support

Accelerating Minimap2 for Accurate Long Read Alignment on GPUs

Accelerating genomic workflows using NVIDIA Parabricks

Accelerating massive short reads mapping for next generation sequencing (abstract only).

mm2-gb: GPU Accelerated Minimap2 for Long Read DNA Mapping

High‐frequency K‐mer Counting at Low Memory Footprint

MetaCache-GPU: Ultra-Fast Metagenomic Classification

GenSeq+: A Scalable High-Performance Accelerator for Genome Sequencing.

High-Performance Genomic Analysis Heterogeneous System Using OpenCL

An efficient parallel algorithm for multiple sequence similarities calculation using a low complexity method.

A graphical, interactive and GPU-enabled workflow to process long-read sequencing data

CUDAMPF++: A Proactive Resource Exhaustion Scheme for Accelerating Homologous Sequence Search on CUDA-enabled GPU

KMC 2: Fast and resource-frugal $k$-mer counting

Accelerating BWA-MEM Read Mapping on GPUs

Parallel Implementation of Mafft on Cuda-Enabled Graphics Hardware