Abstract:Artificial Neural Networks (ANNs) have gained widespread applications across various areas in recent years. The ANN design was initially inspired by the principle of biology. The biological neural network's fundamental response process comprises information transmission and aggregation. The information transmission in biological neurons is often achieved by triggering action potentials that propagate through axons. ANNs utilize activation mechanisms to simulate such biological behavior. However, previous studies have only considered static response conditions, while the biological neuron's response conditions are typically dynamic, depending on multiple factors such as neuron properties and the real-time environment. Therefore, the dynamic response conditions of biological neurons could help improve the static ones of existing activations in ANNs. Additionally, the biological neuron's aggregated response exhibits high specificity for different categories, allowing the nervous system to differentiate and identify objects. Inspired by these biological patterns, we propose a novel Dynamic Neural Response Tuning (DNRT) mechanism, which aligns the response patterns of ANNs with those of biological neurons. DNRT comprises Response-Adaptive Activation (RAA) and Aggregated Response Regularization (ARR), mimicking the biological neuron's information transmission and aggregation behaviors. RAA dynamically adjusts the response condition based on the strength and characteristics of the input signal. ARR is devised to enhance the network's ability to learn category specificity by imposing constraints on the network's response distribution. Extensive experimental studies indicate that the proposed DNRT is highly interpretable, applicable to various mainstream network architectures, and can achieve remarkable performance compared with existing neural response mechanisms in multiple tasks and domains.

Research of field theory based adaptive resonance neural network

Fuzzy Neural Network Based on Hybrid Learning Algorithm and Its Application to Soft Sensor

Adaptive Multi-Scale TF-net for High-Resolution Time-Frequency Representations

AN ADAPTIVE FAULT-TOLERANT NEURAL NETWORK CLASSIFIER

A new ART neural networks for remote sensing image classification

Land Cover Classification in Xianghai Nature Reserve

DeepNFT: Towards Precise Neurofibrillary Tangle Detection Via Improving Multi-scale Feature Fusion and Adversary

A Survey of Adaptive Resonance Theory Neural Network Models for Engineering Applications

FANNC: A Fast Adaptive Neural Network Classifier

A New BP Neural Network Model Based on the Random Fuzzy Theory

An Algorithm of Expressway Automatic Incident Detection Based on ART2 Neural Networks

Adaptive Nonstationary Fuzzy Neural Network

The Research on a Fractionizing and Fitting ART2 Neural Network with Supervise

An Enhanced ART2 Neural Network for Clustering Analysis

Dynamic Neural Response Tuning

Reinforced Interval Type-2 Fuzzy Clustering-based Neural Network Realized Through Attention-based Clustering Mechanism and Successive Learning

Fanre: A Fast Adaptive Neural Regression Estimator

Neural Field Classifiers via Target Encoding and Classification Loss

Field Test and Data Simulation of Foundation Pit Support System Based on BP Neural Network

Robust Fuzzy Neural Network With an Adaptive Inference Engine

A Hybrid Framework for Reservoir Characterization Using Fuzzy Ranking and an Artificial Neural Network