Long short-term memory networks in memristor crossbars

Can Li,Zhongrui Wang,Mingyi Rao,Daniel Belkin,Wenhao Song,Hao Jiang,Peng Yan,Yunning Li,Peng Lin,Miao Hu,Ning Ge,John Paul Strachan,Mark Barnell,Qing Wu,R. Stanley Williams,Jianhua Yang,Qiangfei Xia
DOI: https://doi.org/10.1038/s42256-018-0001-4
2018-01-01
Abstract:Recent breakthroughs in recurrent deep neural networks with long short-term memory (LSTM) units has led to major advances in artificial intelligence. State-of-the-art LSTM models with significantly increased complexity and a large number of parameters, however, have a bottleneck in computing power resulting from limited memory capacity and data communication bandwidth. Here we demonstrate experimentally that LSTM can be implemented with a memristor crossbar, which has a small circuit footprint to store a large number of parameters and in-memory computing capability that circumvents the 'von Neumann bottleneck'. We illustrate the capability of our system by solving real-world problems in regression and classification, which shows that memristor LSTM is a promising low-power and low-latency hardware platform for edge inference.
What problem does this paper attempt to address?