Flash-Based Content Addressable Memory with L2 Distance for Memory-Augmented Neural Network

Haozhang Yang,Peng Huang,Ruiyi Li,Nan Tang,Yizhou Zhang,Zheng Zhou,Lifeng Liu,Xiaoyan Liu
DOI: https://doi.org/10.1016/j.isci.2023.108371
IF: 5.8
2023-01-01
iScience
Abstract:Memory-augmented neural network (MANN) has received increasing attention as a promising approach to achieve lifelong on-device learning, of which implementation of the explicit memory is vital. Content addressable memory (CAM) has been designed to accelerate the explicit memory by harnessing the in-memory-computing capability. In this work, a CAM cell with quadratic code is proposed, and a 1Mb Flash-based multi-bit CAM chip capable of computing Euclidean (L2) distance is fabricated. Compared with ternary CAM, the latency and energy are significantly reduced by 5.3- and 46.6-fold, respectively, for the MANN on Omniglot dataset. Besides, the recognition accuracy has slight degradation (<1%) even after baking for 105 s at 200°C, demonstrating the robustness to environmental disturbance. Performance evaluation indicates a reduction of 471-fold in latency and 1267-fold in energy compared with GPU for search operation. The proposed robust and energy-efficient CAM provides a promising solution to implement lifelong on-device machine intelligence.
What problem does this paper attempt to address?