Efficient Hardware Implementation of Spiking Neural Networks Using Nonstandard Finite Difference Scheme for Leaky Integrate and Fire Neuron Model
K. Venkateswara Reddy,N. Balaji
DOI: https://doi.org/10.1142/s0218126625500380
2024-09-28
Journal of Circuits Systems and Computers
Abstract:Journal of Circuits, Systems and Computers, Ahead of Print. Continuous fire models are not suitable for the implementation of hardware units for applications and hence, suitable discrete versions need to be selected. Moreover, the nonlinear components in the neuronal equations reduce system performance (in the case of frequency and number of resources). This research paper focuses on implementing efficient Spiking Neural Networks (SNNs) using Field-Programmable Gate Array (FPGA), with a specific emphasis on the Leaky Integrate and Fire (LIF) neuron model. Its objective is to optimize the mathematical equations of the LIF model by approximating nonlinear functions. This approach enables the development of a simple, cost-effective and high-speed design. Existing LIF Neuron Hardware Blocks (NHBs) are based on the approximation of continuous models by standard difference schemes such as the Euler method or R–K method etc. Mathematically, such approximations do not exactly represent all dynamics of continuous systems. There are good approximations for small step sizes but they behave oddly when the approximation step size increases. Hence, the corresponding discrete, digital versions are not suitable for applications in all cases. This paper utilizes a Nonstandard Finite Difference (NSFD) scheme for the hardware (FPGA) implementation of the exact model of LIF-based NHB that works for all step sizes. The model presented here has a speed of 438.686[math]MHz which is more than other existing models presented in this paper. It is multiplier-less, unlike earlier models. Further, it is implemented for SNN for basic pattern recognition and established that the proposed model works properly for given patterns. The system was evaluated using large datasets such as MNIST handwritten digit recognition, achieving a classification accuracy of 97.8%. Additionally, it underwent testing for COVID-19 chest CT scan image classification, demonstrating an 84% accuracy rate which is 6% more compared to existing Spiking Neural Networks (SNNs).
engineering, electrical & electronic,computer science, hardware & architecture