Abstract:In-memory computing (IMC) architecture emerges as a promising paradigm, improving the energy efficiency of multiply-and-accumulate (MAC) operations within DNNs by integrating the parallel computations within the memory arrays. Various high-precision analog IMC array designs have been developed based on both SRAM and emerging non-volatile memories. These designs perform MAC operations of partial input and weight, with the corresponding partial products then fed into shift-add circuitry to produce the final MAC results. However, existing works often present intricate shift-add process for weight. The traditional digital shift-add process is limited in throughput due to time-multiplexing of ADCs, and advancing the shift-add process to the analog domain necessitates customized circuit implementations, resulting in compromises in energy and area efficiency. Furthermore, the joint optimization of the partial MAC operations and the weight shift-add process is rarely explored. In this paper, we propose novel, energy efficient dual designs of FeFET based high precision analog IMC featuring inherent shift-add capability. We introduce a FeFET based IMC paradigm that performs partial MAC in each column, and inherently integrates the shift-add process for 4-bit weights by leveraging FeFET's analog storage characteristics. This paradigm supports both 2's complement mode and non-2's complement mode MAC, thereby offering flexible support for 4-/8-bit weight data in 2's complement format. Building upon this paradigm, we propose novel FeFET based dual designs, CurFe for the current mode and ChgFe for the charge mode, to accommodate the high precision analog domain IMC <a class="link-external link-http" href="http://architecture.Evaluation" rel="external noopener nofollow">this http URL</a> results at circuit and system levels indicate that the circuit/system-level energy efficiency of the proposed FeFET-based analog IMC is 1.56$\times$/1.37$\times$ higher when compared to SOTA analog IMC designs.

HyDe: A Hybrid PCM/FeFET/SRAM Device-search for Optimizing Area and Energy-efficiencies in Analog IMC Platforms

FeFET-Based In-Memory Hyperdimensional Encoding Design

Hybrid RRAM/SRAM in-Memory Computing for Robust DNN Acceleration

An Algorithm-Hardware Co-design Framework to Overcome Imperfections of Mixed-signal DNN Accelerators

A Heterogeneous In-Memory Computing Cluster For Flexible End-to-End Inference of Real-World Deep Neural Networks

HCiM: ADC-Less Hybrid Analog-Digital Compute in Memory Accelerator for Deep Learning Workloads

HuNT: Exploiting Heterogeneous PIM Devices to Design a 3-D Manycore Architecture for DNN Training

An in-memory computing architecture based on a duplex 2D material structure for in-situ machine learning

Comparative Evaluation of Memory Technologies for Synaptic Crossbar Arrays -- Part I: Robustness-driven Device-Circuit Co-Design and System Implications

Containing Analog Data Deluge at Edge through Frequency-Domain Compression in Collaborative Compute-in-Memory Networks

Hadamard Product-Based In-Memory Computing Design for Floating Point Neural Network Training

A High Energy Efficient Reconfigurable Hybrid Neural Network Processor for Deep Learning Applications.

A 64-core mixed-signal in-memory compute chip based on phase-change memory for deep neural network inference

A Hybrid Precision Low Power Computing-in-memory Architecture for Neural Networks

SIAM: Chiplet-based Scalable In-Memory Acceleration with Mesh for Deep Neural Networks

IMCE: Energy-efficient Bit-Wise In-Memory Convolution Engine for Deep Neural Network

Device-Circuit-Architecture Co-Exploration for Computing-in-Memory Neural Accelerators

Benchmark of the Compute-in-Memory-Based DNN Accelerator With Area Constraint

Energy Efficient Dual Designs of FeFET-Based Analog In-Memory Computing with Inherent Shift-Add Capability

Benchmarking and modeling of analog and digital SRAM in-memory computing architectures

Hdc-Im: Hyperdimensional Computing In-Memory Architecture Based On Rram