Abstract:Next Generation Sequencing (NGS) is gaining interests due to the increased requirements and the decreased sequencing cost. The important and prerequisite step of most NGS applications is the mapping of short sequences, called reads, to the template reference sequences. Both the explosion of NGS data with over billions of reads generated each day and the data intensive computations pose great challenges to the capability of existing computing systems. In this paper, we take a hash index based algorithm (PerM) as an example to investigate the optimization approaches for accelerating NGS reads mapping on multi-core architectures. First, we propose a new parallel algorithm that reorders bucket access in hash index among multiple threads so that data locality in shared cache is improved. Second, in order to reduce the number of empty hash bucket, we propose a serialized hash index compression algorithm, which coincides with the sequential access nature of our new parallel algorithm. With reduced hash index size, it also becomes possible for us to use longer hash keys, which alleviates the hash conflicts and improves the query performance. Our experiment on an 8-socket 8-cores Intel Xeon X7550 SMP with 128 GB memory shows that the new parallel algorithm reduces LLC miss ratio to be 8%~15% of the original algorithm and the overall performance is improved by 4~11 times (6 times avg.).

Memory Efficient Multithreaded Incremental Segmented Sieve Algorithm

Two Compact Incremental Prime Sieves

Cache optimized linear sieve

An efficient method for integer factorization

Three Euler's Sieves and a Fast Prime Generator (Functional Pearl)

Improved Non-Sieving Quadratic Sieve

Memory-Efficient Sequential Pattern Mining with Hybrid Tries

Scaling up prime factorization with self-organizing gates: A memcomputing approach

A Note on the Behaviour of the Number Field Sieve in the Medium Prime Case: Smoothness of Norms

Hybrid Parallel Bidirectional Sieve based on SMP Cluster

Investigating Memory Optimization of Hash-Index for Next Generation Sequencing on Multi-Core Architecture

Improving the error term in the sieve of Eratosthenes

Sieve methods and the twin prime conjecture

A Friendly Intro to Sieves with a Look Towards Recent Progress on the Twin Primes Conjecture

Weighted sieves with switching

Generating Prime Numbers -- A Fast New Method

Smooth Subsum Search: A heuristic for practical integer factorization

On the theory of prime producing sieves

Models of Prime-Like Sequences Generated by Least Element Sieve Operations Like the Sieve of Eratosthenes

Area-Efficient Modular Reduction Structure and Memory Access Scheme for NTT

An Efficient Implementation of Montgomery Multiplication on Multicore Platform With Optimized Algorithm, Task Partitioning, and Network Architecture