Abstract:The exponential growth of data exerts great pressure on hardware design for database systems. Memory-centric computing (MCC) architecture, which enable compute capabilities near or inside memory storage, demonstrate great potential in enhancing the efficiency of database operations with higher compute parallelism and reduced data movements. However, existing MCC architecture mainly focus on artificial intelligence (AI) computations and those designed for database applications can only run a limited number of standalone queries such as SORT or JOIN, lacking efficient support for increasingly diverse and complex database workloads. For example, realizing a commercial recommendation engine on database requires supporting workloads including but not limited to vector aggregation, convolution or $N$ -hop neighborhoods computing, etc. In this work, we develop a memristor-enabled memory-centric instruction-set architecture (MeMCISA) aiming to efficiently accelerate versatile workloads in modern database systems. MeMCISA features scalable multi-bank memristor-based storage organization with near-memory circuitries and caches in banks. An out-of-order (O0O) scheduling scheme is designed for MeMCISA based on a vector instruction set with four types of instructions (bit-level, element-level, vector-level, and control-level), combining memristor-enabled in-memory computing and near-memory computing to efficiently run workloads with varying computational kernels and data sizes. MeMCISA can support parallel instruction executions across different memristor banks as well as different hardware modules within a memristor bank. Furthermore, we develop data dependency handling mechanisms to support vector dependency scenarios in MeMCISA that do not exist in conventional scalar-based instruction sets. A prototype MeMCISA is implemented based on a 40nm CMOS technology with necessary peripheral hardware including instruction buffer and instruction scheduler. To accurately study MeMCISA performance in real-world database systems, a software-hardware co-designed framework integrating reconfigurable MeMCISA prototype is created that can support end-to-end simulations for database workloads starting from raw software codes. Based on this framework, we evaluate MeMCISA performance with standalone database queries as well as complex database workloads from representative benchmarks including UniBench, neural collaborative filtering (NCF), and ResNet-18. Simulation results demonstrate that MeMCISA achieves up to 41.84 × ~ 1767.70 × in speed compared to general-purpose processors (CPUs/GPUs).

MeMCISA: Memristor-Enabled Memory-Centric Instruction-Set Architecture for Database Workloads

Modeling and Benchmarking Computing-in-Memory for Design Space Exploration.

Ultrafast Self-Rectifying Memristors for Advanced In-Memory Computing

DM-IMCA: A Dual-Mode In-Memory Computing Architecture for General Purpose Processing.

SEE-MCAM: Scalable Multi-bit FeFET Content Addressable Memories for Energy Efficient Associative Search

MeMPA: A Memory Mapped M-SIMD Co-Processor to Cope with the Memory Wall Issue

Memristor Based Mixed-Accuracy Computation-in-Memory System.

A linear compensation method for inference accuracy improvement of memristive in-memory computing

In-memory sparse matrix multiplication with a low-power self-rectifying memristor array

Design memristor-based computing-in-memory for AI accelerators considering the interplay between devices, circuits, and system

A heterogeneous computing system with memristor-based neuromorphic accelerators

Reliability-Aware Training and Performance Modeling for Processing-In-Memory Systems

A Heterogeneous Microprocessor for Intermittent AI Inference Using Nonvolatile-SRAM-based Compute-In-Memory

MEG: A RISCV-based System Emulation Infrastructure for Near-data Processing Using FPGAs and High-bandwidth Memory

A Simulation Framework for Memristor-Based Heterogeneous Computing Architectures

MEG: A RISCV-Based System Simulation Infrastructure for Exploring Memory Optimization Using FPGAs and Hybrid Memory Cube

Bulk-Switching Memristor-Based Compute-In-Memory Module for Deep Neural Network Training

Architecture-circuit-technology Co-Optimization for Resistive Random Access Memory-Based Computation-in-memory Chips

Heterogeneous Instruction Set Architecture for RRAM-enabled In-memory Computing.

ICE: Inline Calibration for Memristor Crossbar-Based Computing Engine

In-Memory Computing With Memristor Arrays