Stochastic neuro-fuzzy system implemented in memristor crossbar arrays

Tuo Shi,Hui Zhang,Shiyu Cui,Jinchang Liu,Zixi Gu,Zhanfeng Wang,Xiaobing Yan,Qi Liu

DOI: https://doi.org/10.1126/sciadv.adl3135

IF: 13.6

2024-03-23

Science Advances

Abstract:Neuro-symbolic artificial intelligence has garnered considerable attention amid increasing industry demands for high-performance neural networks that are interpretable and adaptable to previously unknown problem domains with minimal reconfiguration. However, implementing neuro-symbolic hardware is challenging due to the complexity in symbolic knowledge representation and calculation. We experimentally demonstrated a memristor-based neuro-fuzzy hardware based on TiN/TaO x /HfO x /TiN chips that is superior to its silicon-based counterpart in terms of throughput and energy efficiency by using array topological structure for knowledge representation and physical laws for computing. Intrinsic memristor variability is fully exploited to increase robustness in knowledge representation. A hybrid in situ training strategy is proposed for error minimizing in training. The hardware adapts easier to a previously unknown environment, achieving ~6.6 times faster convergence and ~6 times lower error than deep learning. The hardware energy efficiency is over two orders of magnitude greater than field-programmable gate arrays. This research greatly extends the capability of memristor-based neuromorphic computing systems in artificial intelligence.

multidisciplinary sciences

What problem does this paper attempt to address?

The main problem that this paper attempts to solve is how to implement a robust and efficient neuro - fuzzy system in memristor cross - bar arrays to address the challenges in neuro - symbolic AI. Specifically, the research aims to:

1. **Overcome the complexity of neuro - symbolic hardware implementation**: Traditional CMOS - based hardware faces significant increases in storage, computation time, and power consumption when representing symbolic knowledge. Therefore, researchers explored the possibility of using memristor cross - bar arrays to implement neuro - fuzzy systems.

2. **Leverage the intrinsic memristor variability**: The intrinsic variability of memristors is generally considered to lead to performance degradation, but this study found that this variability can be used as a source of stochastic uncertainty, enhancing the robustness of knowledge representation and improving system performance.

3. **Propose a hybrid in - situ training strategy**: To minimize the cumulative error in computation, researchers proposed a hybrid in - situ training technique with software - hardware co - optimization. This strategy ensures low error during the computation process, especially in regression tasks that are sensitive to error (such as non - linear system identification).

4. **Improve adaptability and convergence speed**: Compared with deep - learning methods, the proposed hardware exhibits a faster convergence speed (about 6.6 times) and a lower error rate (about 6 times) when facing unknown environments, and its energy - efficiency is two orders of magnitude higher than that of the state - of - the - art FPGA.

Through these efforts, this research has greatly expanded the application scope of memristor - based neuromorphic computing systems in the field of artificial intelligence, especially in specific areas that require a balance of performance, interpretability, and robustness.