Mitigate IR-Drop Effect by Modulating Neuron Activation Functions for Implementing Neural Networks on Memristor Crossbar Arrays

Danzhe Song,Fan Yang,Chengxu Wang,Nan Li,Pinfeng Jiang,Bin Gao,Xiangshui Miao,Xingsheng Wang
DOI: https://doi.org/10.1109/led.2023.3285916
IF: 4.8157
2023-01-01
IEEE Electron Device Letters
Abstract:The line resistance (LR) in a large-scale memristor crossbar array can cause serious IR-drop problem, degrading the hardware deployment capability of neural networks (NNs). In this work, two innovation schemes from the level of software are proposed to mitigate the hardware IR-drop problem by intentionally modulating the NN activation function before deploying. The methods are evaluated over typical activation functions and various line resistances on MLP and LeNet-5 for MNIST recognition. Results show the methods can significantly improve the tolerance of NNs to IR-drop and recover the accuracy in some extent. The methods require no extra hardware overhead and reduce the complexity of peripheral circuits, which make them more achievable and attractive.
What problem does this paper attempt to address?