Abstract:Artificial intelligence has made remarkable advancements in recent years, leading to the development of algorithms and models capable of handling ever-increasing amounts of data. The computational demands of these algorithms necessitate circuit and architecture designs that go beyond the von-Neumann paradigm. Content addressable memories (CAMs), which implement parallel associative search functionality within memory blocks to overcome the memory wall bottleneck, have proven to be effective for data-intensive tasks. While current CAM designs have achieved higher storage density and energy efficiency than their CMOS-based counterparts by leveraging emerging non-volatile memories (NVM), most of these implementations are limited to binary storage cells. In this work, we propose SEE-MCAM, scalable and compact multi-bit CAM (MCAM) designs that utilize the three-terminal ferroelectric FET (FeFET) as the proxy. By exploiting the multi-level-cell characteristics of FeFETs, our proposed SEE-MCAM designs enable multi-bit associative search functions and achieve better energy efficiency and performance than existing FeFET-based CAM designs. We validated the functionality of our proposed designs by achieving 3 bits per cell CAM functionality, resulting in 3x improvement in storage density. The area per bit of the proposed SEE-MCAM cell is 8% of the conventional CMOS CAM. We thoroughly investigated the scalability and robustness of the proposed design. Evaluation results suggest that the proposed 2FeFET-1T SEE-MCAM achieves 9.8x more energy efficiency and 1.6x less search latency compared to the CMOS CAM, respectively. When compared to existing MCAM designs, the proposed SEE-MCAM can achieve 8.7x and 4.9x more energy efficiency than ReRAM-based and FeFET-based MCAMs, respectively. Benchmarking results show that our approach provides up to 3 orders of magnitude improvement in speedup and energy efficiency over a GPU implementation in accelerating a novel quantized hyperdimensional computing (HDC) application.

Sparse Matrix Multiplication on CAM Based Accelerator

A Scalable 2T-1Fefet Based Content Addressable Memory Design for Energy Efficient Data Search

CAMASim: A Comprehensive Simulation Framework for Content-Addressable Memory based Accelerators

SpArch: Efficient Architecture for Sparse Matrix Multiplication

Accelerating Sparse Approximate Matrix Multiplication on GPUs

Dedicated Hardware Accelerators for Processing of Sparse Matrices and Vectors: A Survey

GAS: General-Purpose In-Memory-Computing Accelerator for Sparse Matrix Multiplication

Sparse Matrix Multiplication On An Associative Processor

No Zero Padded Sparse Matrix-Vector Multiplication on FPGAs

SEE-MCAM: Scalable Multi-bit FeFET Content Addressable Memories for Energy Efficient Associative Search

Highly Scalable Sparse Matrix Multiplication

Fast Matrix Multiplication via Compiler-only Layered Data Reorganization and Intrinsic Lowering

Accelerating approximate matrix multiplication for near-sparse matrices on GPUs

Configurable sparse matrix - matrix multiplication accelerator on FPGA: A systematic design space exploration approach with quantization effects

Architecture-Aware Configuration and Scheduling of Matrix Multiplication on Asymmetric Multicore Processors

A sparse matrix vector multiplication accelerator based on high-bandwidth memory

Towards a Multi-array Architecture for Accelerating Large-scale Matrix Multiplication on FPGAs

A Low-Power Sparse Convolutional Neural Network Accelerator with Pre-Encoding Radix-4 Booth Multiplier

dCSR: A Memory-Efficient Sparse Matrix Representation for Parallel Neural Network Inference

Performance Modeling and Optimization of Sparse Matrix-Vector Multiplication on NVIDIA CUDA Platform