Abstract:Today’s data-intensive applications increasingly suffer from significant performance bottlenecks due to the limited memory bandwidth of the classical von Neumann architecture. Near-Data Processing (NDP) has been proposed to perform computation near memory or data storage to reduce data movement for improving performance and energy consumption. However, the untrusted NDP processing units (PUs) bring in new threats to workloads that are private and sensitive, such as private database queries and private machine learning inferences. Meanwhile, most existing secure hardware designs do not consider off-chip components trustworthy. Once data leaving the processor, they must be protected, e.g., via block cipher encryption. Unfortunately, current encryption schemes do not support computation over encrypted data stored in memory or storage, hindering the adoption of NDP techniques for sensitive workloads.In this paper, we propose SecNDP, a lightweight encryption and verification scheme for untrusted NDP devices to perform computation over ciphertext and verify the correctness of linear operations. Our encryption scheme leverages arithmetic secret sharing in secure Multi-Party Computation (MPC) to support operations over ciphertext, and uses counter-mode encryption to reduce the decryption latency. The security of the encryption and verification algorithm is formally proven. Compared with a non-NDP baseline, secure computation with SecNDP significantly reduces the memory bandwidth usage while providing security guarantees. We evaluate SecNDP for two workloads of distinct memory access patterns. In the setting of eight NDP units, we show a speedup up to 7.46× and energy savings of 18% over an unprotected non-NDP baseline, approaching the performance gain attained by native NDP without protection. Furthermore, SecNDP does not require any security assumption on NDP to hold, thus, using the same threat model as existing secure processors. SecNDP can be implemented without changing the NDP protocols and their inherent hardware design.

Bridge-NDP: Achieving Efficient Communication-Computation Overlap in Near Data Processing with Bridge Architecture

NDPBridge: Enabling Cross-Bank Coordination in Near-DRAM-Bank Processing Architectures

A Near Memory Computing FPGA Architecture for Neural Network Acceleration

ABNDP: Co-optimizing Data Access and Load Balance in Near-Data Processing

Near Data Acceleration with Concurrent Host Access

Stream-Based Data Placement for Near-Data Processing with Extended Memory

Practical Near-Data Processing for In-Memory Analytics Frameworks

CODA: Enabling Co-location of Computation and Data for Near-Data Processing

SecNDP: Secure Near-Data Processing with Untrusted Memory

A Survey of Near-Data Processing Architectures for Neural Networks

NDPGNN: A Near-Data Processing Architecture for GNN Training and Inference Acceleration

Overcoming Data Transfer Bottlenecks in FPGA-based DNN Accelerators Via Layer Conscious Memory Management

Low-overhead General-purpose Near-Data Processing in CXL Memory Expanders

ABC-DIMM: Alleviating the Bottleneck of Communication in DIMM-based Near-Memory Processing with Inter-DIMM Broadcast

CAP: Communication-aware Automated Parallelization for Deep Learning Inference on CMP Architectures

Edge Computing Aided Congestion Control Using Neuro-Dynamic Programming in NDN

Optimizing power efficiency for 3D stacked GPU-in-memory architecture

An Energy-Efficient Near-Data Processing Accelerator for DNNs that Optimizes Data Accesses

AdaBridge: Dynamic Data and Computation Reuse for Efficient Multi-task DNN Co-evolution in Edge Systems

BFAST: High-Speed and Memory-Efficient Approach for NDN Forwarding Engine.

DIMM-Link: Enabling Efficient Inter-DIMM Communication for Near-Memory Processing