Abstract:Artificial Neural Networks (ANNs) have gained widespread applications across various areas in recent years. The ANN design was initially inspired by the principle of biology. The biological neural network's fundamental response process comprises information transmission and aggregation. The information transmission in biological neurons is often achieved by triggering action potentials that propagate through axons. ANNs utilize activation mechanisms to simulate such biological behavior. However, previous studies have only considered static response conditions, while the biological neuron's response conditions are typically dynamic, depending on multiple factors such as neuron properties and the real-time environment. Therefore, the dynamic response conditions of biological neurons could help improve the static ones of existing activations in ANNs. Additionally, the biological neuron's aggregated response exhibits high specificity for different categories, allowing the nervous system to differentiate and identify objects. Inspired by these biological patterns, we propose a novel Dynamic Neural Response Tuning (DNRT) mechanism, which aligns the response patterns of ANNs with those of biological neurons. DNRT comprises Response-Adaptive Activation (RAA) and Aggregated Response Regularization (ARR), mimicking the biological neuron's information transmission and aggregation behaviors. RAA dynamically adjusts the response condition based on the strength and characteristics of the input signal. ARR is devised to enhance the network's ability to learn category specificity by imposing constraints on the network's response distribution. Extensive experimental studies indicate that the proposed DNRT is highly interpretable, applicable to various mainstream network architectures, and can achieve remarkable performance compared with existing neural response mechanisms in multiple tasks and domains.

Samples Selection for Artificial Neural Network Training in Preliminary Structural Design

Dual-Band FSS Inverse Design Using ANN with Cognition-Driven Sampling

Probabilistic Evaluation of Ground-Support Interaction for Deep Rock Excavation Using Artificial Neural Network and Uniform Design

Comparing sampling techniques to chart parameter space of 21 cm global signal with Artificial Neural Networks

An algorithm of training sample selection for integrated circuit device modeling based on artificial neural networks

Estimation of tunnel support pattern selection using artificial neural network

Large Deviations for Accelerating Neural Networks Training

Comparative Study of Structural Anomaly Diagnosis Based on ANN Model Using Random Displacement and Acceleration Responses with Incomplete Measurements

Effectiveness Analysis of Structural Anomaly Diagnosis Based on ANN Model

A Gentle Introduction to Artificial Neural Networks

Neural Networks: Computational Models and Applications - ReadingSample

Application of Artificial Neural Network in Tunnel Engineering: A Systematic Review

Sampling complex topology structures for spiking neural networks

ANNA: Advanced neural network algorithm for optimization of structures

Transforming to Yoked Neural Networks to Improve ANN Structure

Sample Complexity of Algorithm Selection Using Neural Networks and Its Applications to Branch-and-Cut

Dynamic Neural Response Tuning

On the Training Algorithms for Artificial Neural Network in Predicting the Shear Strength of Deep Beams

Application and Prospect of Artificial Neural Networks in Materials Science

Application of Neural Network Models with Ultra-Small Samples to Optimize the Ultrasonic Consolidation Parameters for 'PEI Adherend/Prepreg (CF-PEI Fabric)/PEI Adherend' Lap Joints