Abstract:Read mapping, which maps billions of reads to a reference DNA, poses a significant performance bottleneck in genomic analysis. Current accelerators for read mapping are primarily bounded by the intensive and random memory access to huge datasets. Near-data processing (NDP) infrastructures are promising to provide extremely high bandwidth. However, existing frameworks failed to reach this potential due to poor locality and high redundancy. Our idea is to introduce prediction under the insight that candidate mapping positions become predictable when the reference is organized in coarse-grain slices. We present GEM ( Ge nomic M emory), an ultra-efficient near-memory accelerator for read mapping. GEM adopts a novel data-centric framework, named dividing-and-predictive-scattering (DPS), which synthesizes information of seed existence to predict the target mapping locations to reduce memory access redundancy. During preparation, DPS divides the reference into coarse-grained slices and creates predictive filters to assess the likelihood of reads belonging to each slice. During mapping, DPS predicts and scatters reads to considerably fewer slices compared than without prediction. By employing small on-chip SRAM-based predictors with high accuracy, DPS minimizes unnecessary DRAM access and data movement from remote memory. In essence, DPS trades pre-seeding predictors for localized access patterns and low redundancy, hence achieving high throughput for data-intensive applications. We implement GEM by integrating coarse-grain reconfigurable architectures (CGRAs) in the logic layer of a 3D-stacked DRAM infrastructure, utilizing the massive banks as slices. GEM leverages CGRAs for their flexibility in supporting various algorithms tailored to different datasets. Bloom filters are leveraged for slice prediction, providing an error rate below 1%. Evaluation results demonstrate that GEM reduces memory requests by 95% and alignments by 87%, achieving a throughput improvement of 15.3× and 11.0× compared to compute-centric and broadcast-based baselines on the same NDP platform. Overall, GEM achieves a $3.5\times$ throughput improvement and $2.1\times$ energy efficiency compared to state-of-the-art ASIC accelerators.

ABNDP: Co-optimizing Data Access and Load Balance in Near-Data Processing

CODA: Enabling Co-location of Computation and Data for Near-Data Processing

Practical Near-Data Processing for In-Memory Analytics Frameworks

NDPBridge: Enabling Cross-Bank Coordination in Near-DRAM-Bank Processing Architectures

Stream-Based Data Placement for Near-Data Processing with Extended Memory

Near Data Acceleration with Concurrent Host Access

Low-overhead General-purpose Near-Data Processing in CXL Memory Expanders

Optimizing power efficiency for 3D stacked GPU-in-memory architecture

A Survey of Near-Data Processing Architectures for Neural Networks

Near-Data Processing for Differentiable Machine Learning Models

SecNDP: Secure Near-Data Processing with Untrusted Memory

Near-data processing in database systems on native computational storage under HTAP workloads

Bayesian Theory Based Adaptive Proximity Data Accessing For Cmp Caches

NDPGNN: A Near-Data Processing Architecture for GNN Training and Inference Acceleration

NDSEARCH: Accelerating Graph-Traversal-Based Approximate Nearest Neighbor Search through Near Data Processing

AIDTN: Towards a Real-Time AI Optimized DTN System with NVMeoF

GEM: Ultra-Efficient Near-Memory Reconfigurable Acceleration for Read Mapping by Dividing and Predictive Scattering

A Survey of Resource Management for Processing-in-Memory and Near-Memory Processing Architectures

A Spatial and Temporal Locality-Aware Adaptive Cache Design with Network Optimization for Tiled Many-Core Architectures.

G-NMP: Accelerating Graph Neural Networks with DIMM-based Near-Memory Processing

NDRec: A Near-Data Processing System for Training Large-Scale Recommendation Models