Edge learning using a fully integrated neuro-inspired memristor chip

Wenbin Zhang,Peng Yao,Bin Gao,Qi Liu,Dong Wu,Qingtian Zhang,Yuankun Li,Qi Qin,Jiaming Li,Zhenhua Zhu,Yi Cai,Dabin Wu,Jianshi Tang,He Qian,Yu Wang,Huaqiang Wu

DOI: https://doi.org/10.1126/science.ade3483

IF: 56.9

2023-09-15

Science

Abstract:Learning is highly important for edge intelligence devices to adapt to different application scenes and owners. Current technologies for training neural networks require moving massive amounts of data between computing and memory units, which hinders the implementation of learning on edge devices. We developed a fully integrated memristor chip with the improvement learning ability and low energy cost. The schemes in the STELLAR architecture, including its learning algorithm, hardware realization, and parallel conductance tuning scheme, are general approaches that facilitate on-chip learning by using a memristor crossbar array, regardless of the type of memristor device. Tasks executed in this study included motion control, image classification, and speech recognition.

multidisciplinary sciences

What problem does this paper attempt to address?

The paper attempts to address the issue of achieving efficient, low-power machine learning capabilities on edge devices. Specifically, the paper discusses the obstacles in applying current neural network training techniques on edge devices, namely the high energy consumption and latency caused by moving large amounts of data between computation and storage units. To solve these problems, the research team developed a fully integrated memristor chip with improved learning capabilities and low energy consumption.

The main contributions of the paper include:
1. **Development of a fully integrated memristor chip**: This chip achieves efficient on-chip learning without relying on external memory by using a memristor crossbar array and complementary metal-oxide-semiconductor (CMOS) circuits.
2. **Proposed the STELLAR architecture**: This architecture includes learning algorithms, hardware implementation, and a parallel conductance tuning scheme, enabling on-chip learning on different types of memristor devices.
3. **Optimized the on-chip learning process**: By using a verification-free conductance tuning scheme, symbol-based weight update direction calculation, and cyclic parallel conductance tuning scheme, the energy consumption and latency are significantly reduced.
4. **Validated on multiple tasks**: Including tasks such as motion control, image classification, and speech recognition, demonstrating the potential of the chip in practical applications.

In summary, the paper aims to achieve efficient, low-power machine learning on edge devices through the memristor chip and STELLAR architecture, thereby enhancing the adaptability and performance of these devices in various application scenarios.