Abstract:As CMOS technology advances, the performance gap between the CPU and main memory has not improved. Furthermore, the hardware deployed for Internet of Things (IoT) applications need to process ever growing volumes of data, which can further exacerbate the "memory wall". Computing-in-memory (CiM) architectures, where logic and arithmetic operations are performed in memory, can significantly reduce energy and latency overheads associated with data transfer, and potentially alleviate processor-memory bottlenecks. In this paper, we consider the utility of ternary content addressable memory (TCAM) arrays and CiM arrays based on ferroelectric field effect transistors (FeFETs) to support emerging machine learning models that can learn new classes of data with significantly less training overhead - highly desirable in IoT applications. Architecturally, we use TCAM and CiM arrays to implement the external memory module in a memory enhanced neural network (MENN) - which can be used to minimize catastrophic forgetting - a major problem in applications such as lifelong and few-shot learning. As a representative example, we achieve 95.14% accuracy for a few-shot learning task with the Omniglot data set by using a combined L∞ infinity and L1 distance metric computed via a TCAM-CiM cascaded architecture (as opposed to 99.06% accuracy assuming a GPU backed by DRAM). While there is a slight drop in accuracy, the TCAM-CiM approach is 4.34X faster and 4.18X more energy efficient than a CMOS implementation for the same task. The ability of an FeFET to serve as both a compact logic and storage element helps to enable dense CiM and TCAM structures that drive the aforementioned improvements to application-level figures of merit (FOMs).

IMPACT:InMemory ComPuting Architecture Based on Y-FlAsh Technology for Coalesced Tsetlin Machine Inference

The Impact of Non-linear NVM Devices on In-Memory Computing

In-Memory Learning Automata Architecture using Y-Flash Cell

Neural Network Acceleration and Voice Recognition with a Flash-based In-Memory Computing SoC

A 40nm 1mb 35.6 TOPS/W MLC NOR-Flash Based Computation-in-Memory Structure for Machine Learning

IMBUE: In-Memory Boolean-to-CUrrent Inference ArchitecturE for Tsetlin Machines

Flash Memory Array for Efficient Implementation of Deep Neural Networks

In-Memory Computing: The Next-Generation AI Computing Paradigm

In-Memory Computing Integrated Structure Circuit Based on Nonvolatile Flash Memory Unit

MLFlash-CIM: Embedded Multi-Level NOR-Flash Cell based Computing in Memory Architecture for Edge AI Devices

Design of Computing-in-Memory (CIM) with Vertical Split-Gate Flash Memory for Deep Neural Network (DNN) Inference Accelerator

In-memory Implementation of On-chip Trainable and Scalable ANN for AI/ML Applications

33.2 A Fully Integrated Analog ReRAM Based 78.4TOPS/W Compute-In-Memory Chip with Fully Parallel MAC Computing.

In-memory Computing with Emerging Nonvolatile Memory Devices

DASM: Data-Streaming-Based Computing in Nonvolatile Memory Architecture for Embedded System

Containing Analog Data Deluge at Edge through Frequency-Domain Compression in Collaborative Compute-in-Memory Networks

An RRAM-Based Computing-in-Memory Architecture and Its Application in Accelerating Transformer Inference

Ferroelectric FET Based In-Memory Computing for Few-Shot Learning.

IMAC: In-Memory Multi-Bit Multiplication and ACcumulation in 6T SRAM Array

Hdc-Im: Hyperdimensional Computing In-Memory Architecture Based On Rram

Flash-based Computing In-Memory Scheme for IOT.