Abstract:Edge computing is a promising solution for handling high-dimensional, multispectral analog data from sensors and IoT devices for applications such as autonomous drones. However, edge devices' limited storage and computing resources make it challenging to perform complex predictive modeling at the edge. Compute-in-memory (CiM) has emerged as a principal paradigm to minimize energy for deep learning-based inference at the edge. Nevertheless, integrating storage and processing complicates memory cells and/or memory peripherals, essentially trading off area efficiency for energy efficiency. This paper proposes a novel solution to improve area efficiency in deep learning inference tasks. The proposed method employs two key strategies. Firstly, a Frequency domain learning approach uses binarized Walsh-Hadamard Transforms, reducing the necessary parameters for DNN (by 87% in MobileNetV2) and enabling compute-in-SRAM, which better utilizes parallelism during inference. Secondly, a memory-immersed collaborative digitization method is described among CiM arrays to reduce the area overheads of conventional ADCs. This facilitates more CiM arrays in limited footprint designs, leading to better parallelism and reduced external memory accesses. Different networking configurations are explored, where Flash, SA, and their hybrid digitization steps can be implemented using the memory-immersed scheme. The results are demonstrated using a 65 nm CMOS test chip, exhibiting significant area and energy savings compared to a 40 nm-node 5-bit SAR ADC and 5-bit Flash ADC. By processing analog data more efficiently, it is possible to selectively retain valuable data from sensors and alleviate the challenges posed by the analog data deluge.

DPAM: A Demand-Based Page-Level Address Mappings Algorithm in Flash Memory for Smart Industrial Edge Devices.

Optimized Address Translation Method for Flash Memory

Adaptive Energy-Aware Design Of A Multi-Bank Flash-Memory Storage System

Optimizing Translation Information Management In Nand Flash Memory Storage Systems

DPW-LRU: an Efficient Buffer Management Policy Based on Dynamic Page Weight for Flash Memory in Cyber-Physical Systems.

A Novel Data Aggregation Preprocessing Algorithm in Flash Memory for Iot Based Power Grid Storage System

Data Placement Through Clustering Sequential Writes and Isolating Cold Pages for Write Amplification Reduction in NAND Flash Memory

NAND SSD address mapping strategy

Design of Computing-in-Memory (CIM) with Vertical Split-Gate Flash Memory for Deep Neural Network (DNN) Inference Accelerator

Gasa: A New Page Replacement Algorithm for Nand Flash Memory

Design and Implementation of a Hybrid Mapping Flash Translation Layer

A 1.041-Mb/mm 2 27.38-TOPS/W Signed-INT8 Dynamic-Logic-Based ADC-less SRAM Compute-in-Memory Macro in 28nm with Reconfigurable Bitwise Operation for AI and Embedded Applications

Containing Analog Data Deluge at Edge through Frequency-Domain Compression in Collaborative Compute-in-Memory Networks

A survey of address translation technologies for flash memories

Search-in-Memory: Reliable, Versatile, and Efficient Data Matching in SSD's NAND Flash Memory Chip for Data Indexing Acceleration

Flash-based Computing In-Memory Scheme for IOT.

An Effective Dynamic Wear Leveling In The Application Of Solid State Drives

Flash Memory Array for Efficient Implementation of Deep Neural Networks

An ultra-high-density and energy-efficient content addressable memory design based on 3D-NAND flash

Design of Huge Capacity Memory Based on NAND Flash

Novel Silicon-Based Flash Cell Structures for Low Power and High Density Memory Applications