Abstract:The study of neuron interactions and hardware implementations are crucial research directions in neuroscience, particularly in developing large-scale biological neural networks. The FitzHugh-Nagumo (FHN) model is a popular neuron model with highly biological plausibility, but its complexity makes it difficult to apply at scale. This paper presents a cost-saving and improved precision approximation algorithm for the digital implementation of the FHN model. By converting the computational data into floating-point numbers, the original multiplication calculations are replaced by adding the floating-point exponent part and fitting the mantissa part with piecewise linear. In the hardware implementation, shifters and adders are used, greatly reducing resource overhead. Implementing FHN neurons by this approximation calculations on FPGA reduces the normalized root mean square error (RMSE) to 3.5% of the state-of-the-art (SOTA) while maintaining a performance overhead ratio improvement of 1.09 times. Compared to implementations based on approximate multipliers, the proposed method achieves a 20% reduction in error at the cost of a 2.8% increase in overhead.This model gained additional biological properties compared to LIF while reducing the deployment scale by only 9%. Furthermore, the hardware implementation of nine coupled circular networks with eight nodes and directional diffusion was carried out to demonstrate the algorithm's effectiveness on neural networks. The error decreased to 60% compared to the single neuron of the SOTA. This hardware-friendly algorithm allows for the low-cost implementation of high-precision hardware simulation, providing a novel perspective for studying large-scale, biologically plausible neural networks.

A Novel Approximation Methodology and Its Efficient VLSI Implementation for the Sigmoid Function.

A Modular Approximation Methodology for Efficient Fixed-Point Hardware Implementation of the Sigmoid Function

Low Cost Design for Elementary Function Approximation Based on Piecewise Quadratic Interpolation

LMM: A Fixed-Point Linear Mapping Based Approximate Multiplier for IoT

A Universal Approximation Method and Optimized Hardware Architectures for Arithmetic Functions Based on Stochastic Computing

A Universal Method of Linear Approximation with Controllable Error for the Efficient Implementation of Transcendental Functions

INA: Incremental Network Approximation Algorithm for Limited Precision Deep Neural Networks

A High-Precision Implementation of the Sigmoid Activation Function for Computing-in-Memory Architecture

An Efficient Hardware Architecture with Adjustable Precision and Extensible Range to Implement Sigmoid and Tanh Functions

FPGA Implementation for the Sigmoid with Piecewise Linear Fitting Method Based on Curvature Analysis

Piecewise Parabolic Approximate Computation Based on an Error-Flattened Segmenter and a Novel Quantizer

DIF-LUT: A Simple Yet Scalable Approximation for Non-Linear Activation Function on FPGA

Low Error-Rate Approximate Multiplier Design for DNNs with Hardware-Driven Co-Optimization

A fine-grained mixed precision DNN accelerator using a two-stage big-little core RISC-V MCU.

Low-Power and Low-Latency Hardware Implementation of Approximate Hyperbolic and Exponential Functions for Embedded System Applications

Circuit design of an improved approximate squaring function

A CORDIC-Based Architecture with Adjustable Precision and Flexible Scalability to Implement Sigmoid and Tanh Functions.

Deep Network Approximation: Achieving Arbitrary Accuracy with Fixed Number of Neurons

Floating-Point Approximation Enabling Cost-Effective and High-Precision Digital Implementation of FitzHugh-Nagumo Neural Networks

Efficient Approximate Floating-Point Multiplier With Runtime Reconfigurable Frequency and Precision

Approximate Logic Synthesis in the Loop for Designing Low-Power Neural Network Accelerator.