Abstract:Read mapping, which maps billions of reads to a reference DNA, poses a significant performance bottleneck in genomic analysis. Current accelerators for read mapping are primarily bounded by the intensive and random memory access to huge datasets. Near-data processing (NDP) infrastructures are promising to provide extremely high bandwidth. However, existing frameworks failed to reach this potential due to poor locality and high redundancy. Our idea is to introduce prediction under the insight that candidate mapping positions become predictable when the reference is organized in coarse-grain slices. We present GEM ( Ge nomic M emory), an ultra-efficient near-memory accelerator for read mapping. GEM adopts a novel data-centric framework, named dividing-and-predictive-scattering (DPS), which synthesizes information of seed existence to predict the target mapping locations to reduce memory access redundancy. During preparation, DPS divides the reference into coarse-grained slices and creates predictive filters to assess the likelihood of reads belonging to each slice. During mapping, DPS predicts and scatters reads to considerably fewer slices compared than without prediction. By employing small on-chip SRAM-based predictors with high accuracy, DPS minimizes unnecessary DRAM access and data movement from remote memory. In essence, DPS trades pre-seeding predictors for localized access patterns and low redundancy, hence achieving high throughput for data-intensive applications. We implement GEM by integrating coarse-grain reconfigurable architectures (CGRAs) in the logic layer of a 3D-stacked DRAM infrastructure, utilizing the massive banks as slices. GEM leverages CGRAs for their flexibility in supporting various algorithms tailored to different datasets. Bloom filters are leveraged for slice prediction, providing an error rate below 1%. Evaluation results demonstrate that GEM reduces memory requests by 95% and alignments by 87%, achieving a throughput improvement of 15.3× and 11.0× compared to compute-centric and broadcast-based baselines on the same NDP platform. Overall, GEM achieves a $3.5\times$ throughput improvement and $2.1\times$ energy efficiency compared to state-of-the-art ASIC accelerators.

NDPBridge: Enabling Cross-Bank Coordination in Near-DRAM-Bank Processing Architectures

ABNDP: Co-optimizing Data Access and Load Balance in Near-Data Processing

Stream-Based Data Placement for Near-Data Processing with Extended Memory

DaDianNao: A Machine-Learning Supercomputer

Practical Near-Data Processing for In-Memory Analytics Frameworks

CODA: Enabling Co-location of Computation and Data for Near-Data Processing

Near Data Acceleration with Concurrent Host Access

Low-overhead General-purpose Near-Data Processing in CXL Memory Expanders

SecNDP: Secure Near-Data Processing with Untrusted Memory

A Survey of Near-Data Processing Architectures for Neural Networks

Minimizing Bank Conflict Delay for Real-Time Embedded Multicore Systems via Bank Mapping.

CMDS: Cross-layer Dataflow Optimization for DNN Accelerators Exploiting Multi-bank Memories

Reducing Performance Impact of DRAM Refresh by Parallelizing Refreshes with Accesses

RC-NVM: Enabling Symmetric Row and Column Memory Accesses for In-memory Databases

DIMM-Link: Enabling Efficient Inter-DIMM Communication for Near-Memory Processing

Banshee: Bandwidth-Efficient DRAM Caching Via Software/Hardware Cooperation

Improving DRAM Performance by Parallelizing Refreshes with Accesses

A Study of Leveraging Memory Level Parallelism for DRAM System on Multi-core/Many-Core Architecture

Near-Data Processing for Differentiable Machine Learning Models

GEM: Ultra-Efficient Near-Memory Reconfigurable Acceleration for Read Mapping by Dividing and Predictive Scattering

MeNDA: A Near-Memory Multi-way Merge Solution for Sparse Transposition and Dataflows