Abstract:Homomorphic encryption (HE) allows direct computations on encrypted data. Despite numerous research efforts, the practicality of HE schemes remains to be demonstrated. In this regard, the enormous size of ciphertexts involved in HE computations degrades computational efficiency. Near-memory processing (NMP) and computing-in-memory (CiM)—paradigms where computation is done within the memory boundaries—represent architectural solutions for reducing latency and energy associated with data transfers in data-intensive applications, such as HE. This article introduces CiM-HE, a CiM architecture that can support operations for the Brakerski/Fan–Vercauteren (B/FV) scheme, a somewhat HE scheme for general computation. CiM-HE hardware consists of customized peripherals, such as sense amplifiers, adders, bit shifters, and sequencing circuits. The peripherals are based on CMOS technology and could support computations with memory cells of different technologies. Circuit-level simulations are used to evaluate our CiM-HE framework assuming a 6T-SRAM memory. We compare our CiM-HE implementation against: 1) two optimized CPU HE implementations and 2) a field-programmable gate array (FPGA)-based HE accelerator implementation. Compared with a CPU solution, CiM-HE obtains speedups between $4.6times $ and $9.1times $ and energy savings between $266.4times $ and $532.8times $ for homomorphic multiplications (the most expensive HE operation). Also, a set of four end-to-end tasks, i.e., mean, variance, linear regression, and inference, are up to $1.1times $ , $7.7times $ , $7.1times $ , and $7.5times $ faster (and $301.1times $ , $404.6times $ , $532.3times $ , and $532.8times $ more energy efficient). Compared with CPU-based HE in previous work, CiM-HE obtains $14.3times $ speedup and $> 2600times $ energy savings. Finally, our design offers $2.2times $ speedup with $88.1times $ energy savings compared with a state-of-the-art FPGA-based accelerator.

A Multi-Layer Parallel Hardware Architecture for Homomorphic Computation in Machine Learning

Efficient Homomorphic Convolution Designs on FPGA for Secure Inference

CHAM: A Customized Homomorphic Encryption Accelerator for Fast Matrix-Vector Product

Performance Modeling and FPGA Acceleration of Homomorphic Encrypted Convolution

Coxhe: A Software-Hardware Co-Design Framework for FPGA Acceleration of Homomorphic Computation

Heterogeneous Reconfigurable Accelerator for Homomorphic Evaluation on Encrypted Data

SHAPER: A General Architecture for Privacy-Preserving Primitives in Secure Machine Learning.

FPGA-Based Hardware Accelerator of Homomorphic Encryption for Efficient Federated Learning

FxHENN: FPGA-based acceleration framework for homomorphic encrypted CNN inference

GPU Accelerated Full Homomorphic Encryption Cryptosystem, Library and Applications for IoT Systems

SAFE: A Scalable Homomorphic Encryption Accelerator for Vertical Federated Learning

HE-Booster: an Efficient Polynomial Arithmetic Acceleration on GPUs for Fully Homomorphic Encryption

APAS: Application-Specific Accelerators for RLWE-Based Homomorphic Linear Transformations

APACHE: A Processing-Near-Memory Architecture for Multi-Scheme Fully Homomorphic Encryption

CoFHE: Software and Hardware Co-design for FHE-based Machine Learning As a Service

HEAX: An Architecture for Computing on Encrypted Data

HMC-FHE: A Heterogeneous Near Data Processing Framework for Homomorphic Encryption

Parallel Photonic Acceleration Processor for Matrix-Matrix Multiplication

Computing-in-Memory for Performance and Energy-Efficient Homomorphic Encryption

SoK: Fully Homomorphic Encryption Accelerators

N3H-Core: Neuron-designed Neural Network Accelerator via FPGA-based Heterogeneous Computing Cores