Abstract:Artificial Neural Networks (ANNs) have gained widespread applications across various areas in recent years. The ANN design was initially inspired by the principle of biology. The biological neural network's fundamental response process comprises information transmission and aggregation. The information transmission in biological neurons is often achieved by triggering action potentials that propagate through axons. ANNs utilize activation mechanisms to simulate such biological behavior. However, previous studies have only considered static response conditions, while the biological neuron's response conditions are typically dynamic, depending on multiple factors such as neuron properties and the real-time environment. Therefore, the dynamic response conditions of biological neurons could help improve the static ones of existing activations in ANNs. Additionally, the biological neuron's aggregated response exhibits high specificity for different categories, allowing the nervous system to differentiate and identify objects. Inspired by these biological patterns, we propose a novel Dynamic Neural Response Tuning (DNRT) mechanism, which aligns the response patterns of ANNs with those of biological neurons. DNRT comprises Response-Adaptive Activation (RAA) and Aggregated Response Regularization (ARR), mimicking the biological neuron's information transmission and aggregation behaviors. RAA dynamically adjusts the response condition based on the strength and characteristics of the input signal. ARR is devised to enhance the network's ability to learn category specificity by imposing constraints on the network's response distribution. Extensive experimental studies indicate that the proposed DNRT is highly interpretable, applicable to various mainstream network architectures, and can achieve remarkable performance compared with existing neural response mechanisms in multiple tasks and domains.

Nonlinear Robust Controller Tuning Based on Artificial Neural Network

Parameter Self-Tuning of SISO Compact-Form Model-Free Adaptive Controller Based on Long Short-Term Memory Neural Network

Neuron Variable Structural PID Control Scheme for Nonlinear Plants

A multivariable nonlinear self-tuning PID controller

An Intelligent Adaptive Robust Controller Based on Neural Network for a Pneumatic System

Study on NRC Tuning Rule by Monte-Carlo Simulation

Nonlinear adaptive control based on RBF networks and multi-model method

Nonlinear Predictive Functional Control Based on Artificial Neural Network

A Pid Controller With Neuron Tuning Parameters For Multi-Model Plants

Neural Control for Underdamping Plants

Study On Application Of System Identification Of A 6r Serial Manipulator Using Artificial Neural Network

High Precision Adaptive Robust Neural Network Control of a Servo Pneumatic System

Parameter Self-Tuning of SISO Compact-Form Model-Free Adaptive Controller based on Neural Network with System Error Set as Input

Study on Parameters Tuning Rule of Nonlinear Robust Controller for TITO Systems

Model-free Neural Control of a Class of Nonlinear Plants

Parameter Tuning for Nonlinear Robust Controller with High Gain Observer

Robust Nonlinear Model Predictive Control Algorithm Based on Reduced Precision Solution Criteria

Dynamic Neural Response Tuning

Support Vector Regression Based Nonlinear Model Reference Adaptive Control

Neural Network Adaptive Robust Control of Nonlinear Systems in Semi-Strict Feedback Form

A Novel Auto-Tuning Robust Pid Controller for Networked Control System