Energy-efficient Ferroelectric-FET-based Agent with Memory Trace for Enhanced Reinforcement Learning

Jin Luo,Boyi Fu,Yide Du,Xinming Wei,Chang Su,Mengxuan Yang,Qianqian Huang,Ru Huang
DOI: https://doi.org/10.1109/led.2023.3345359
IF: 4.8157
2023-01-01
IEEE Electron Device Letters
Abstract:In this work, for the first time, we algorithmically merge the memory trace effect into activation function in neural network for reinforcement learning, and a novel ferroelectric FET (FeFET) based agent with both activation function and plastic weight is proposed and experimentally demonstrated. By exploiting the physics of short-time scale dynamics of depolarization process induced by depolarization field, the activation function with memory trace effect can be emulated in one FeFET at ultra-low operating voltage of 0.5V. In addition, the plastic weight with multilevel states can be realized by the long-time scale retention of spontaneous polarization in FeFET simultaneously. Moreover, based on the proposed FeFET-based agent, reinforcement learning is demonstrated with convergence rate boost and high energy efficiency. This work provides a promising highly-integrated agent solution for RL system.
What problem does this paper attempt to address?