Abstract:The implementation of neural networks (NNs) on edge devices enables local processing of wireless data, but faces challenges such as high computational complexity and memory requirements when deep neural networks (DNNs) are used. Shallow neural networks customized for specific problems are more efficient, requiring fewer resources and resulting in a lower latency solution. An additional benefit of the smaller network size is that it is suitable for real-time processing on edge devices. The main concern with shallow neural networks is their accuracy performance compared to DNNs. In this paper, we demonstrate that a customized adaptive activation function (AAF) can meet the accuracy of a DNN. We designed an efficient FPGA implementation for a customized segmented spline curve neural network (SSCNN) structure to replace the traditional fixed activation function with an AAF. We compared our SSCNN with different neural network structures such as a real-valued time-delay neural network (RVTDNN), an augmented real-valued time-delay neural network (ARVTDNN), and deep neural networks with different parameters. Our proposed SSCNN implementation uses 40% fewer hardware resources and no block RAMs compared to the DNN with similar accuracy. We experimentally validated this computationally efficient and memory-saving FPGA implementation of the SSCNN for digital predistortion of radio-frequency (RF) power amplifiers using the AMD/Xilinx RFSoC ZCU111. The implemented solution uses less than 3% of the available resources. The solution also enables an increase of the clock frequency to 221.12 MHz, allowing the transmission of wide bandwidth signals.

Implementation of Artificial Neural Network for Real Time Applications Using Field Programmable Analog Arrays

Research on Field Programmable Neuron Array (FPNA) Based on Reusable ANN Neurons

Circuit Implementation of FitzHugh-Nagumo Neuron Model Using Field Programmable Analog Arrays

A Real-time P-SFA hardware implementation of Deep Neural Networks using FPGA

Nanoscale Accelerators for Artificial Neural Networks

A FPGA-Based, Granularity-Variable Neuromorphic Processor and Its Application in a MIMO Real-Time Control System.

FPAA Based on Integration of CMOS and Nanojunction Devices for Neuromorphic Applications

Field-programmable gate array implementation of a probabilistic neural network for motor cortical decoding in rats.

Research of Artificial Neural Network Arithmetic Based on FPGA

Mixed-grained CMOS Field Programmable Analog Array for Smart Sensory Applications

A New Hybrid Neural System Interfacing Neurons and Silicon Hardware for Fast Signal Recognition

ASIC Design of Nanoscale Artificial Neural Networks for Inference/Training by Floating-Point Arithmetic

Performance analysis of multiple input single layer neural network hardware chip

A Cmos Field Programmable Analog Array For Intelligent Sensory Application

Adaptive Integratable Hardware Realization of Analog Neural Networks for Nonlinear System

EPHA: An Energy-efficient Parallel Hybrid Architecture for ANNs and SNNs

Efficient Hardware Realizations of Feedforward Artificial Neural Networks

Accuracy vs. Efficiency: Achieving Both through FPGA-Implementation Aware Neural Architecture Search

Efficient Neural Networks on the Edge with FPGAs by Optimizing an Adaptive Activation Function

A Power-Efficient and Re-Configurable Analog Artificial Neural Network Classifier

A Configurable Architecture of ANN in Hardware with Resource-Efficient Reusable Neuron