Abstract:Artificial Neural Networks (ANNs) have gained widespread applications across various areas in recent years. The ANN design was initially inspired by the principle of biology. The biological neural network's fundamental response process comprises information transmission and aggregation. The information transmission in biological neurons is often achieved by triggering action potentials that propagate through axons. ANNs utilize activation mechanisms to simulate such biological behavior. However, previous studies have only considered static response conditions, while the biological neuron's response conditions are typically dynamic, depending on multiple factors such as neuron properties and the real-time environment. Therefore, the dynamic response conditions of biological neurons could help improve the static ones of existing activations in ANNs. Additionally, the biological neuron's aggregated response exhibits high specificity for different categories, allowing the nervous system to differentiate and identify objects. Inspired by these biological patterns, we propose a novel Dynamic Neural Response Tuning (DNRT) mechanism, which aligns the response patterns of ANNs with those of biological neurons. DNRT comprises Response-Adaptive Activation (RAA) and Aggregated Response Regularization (ARR), mimicking the biological neuron's information transmission and aggregation behaviors. RAA dynamically adjusts the response condition based on the strength and characteristics of the input signal. ARR is devised to enhance the network's ability to learn category specificity by imposing constraints on the network's response distribution. Extensive experimental studies indicate that the proposed DNRT is highly interpretable, applicable to various mainstream network architectures, and can achieve remarkable performance compared with existing neural response mechanisms in multiple tasks and domains.

Implementation of Artificial Neural Networks in MapReduce Optimization

Ant Algorithm Based Optimization Of Neural Network Model Of Water Distribution System

An Efficient Algorithm for Mapping Deep Learning Applications on the NoC Architecture

An Adaptive Auto-configuration Tool for Hadoop

Automatic Generation and Optimization Framework of NoC-Based Neural Network Accelerator Through Reinforcement Learning

Distributed Framework of Artificial Neural Network for Big Data Analysis

An ANN-Based Approach for Real-Time Scheduling in Cloud Manufacturing

A parallel computing platform for training large scale neural networks

AOME: Autonomous Optimal Mapping Exploration Using Reinforcement Learning for NoC-based Accelerators Running Neural Networks

Dynamic Neural Response Tuning

Catalyst Optimization Design Based on Artificial Neural Network

Automatic Optimization for MapReduce Programs

Application of artificial neural network to refining-transportation-marketing-planning system for solving its undefined problems

Research on Chemical Process Optimization Based on Artificial Neural Network Algorithm

Auto-Tuning Spark Configurations Based On Neural Network

Artificial neural networks for resources optimization in energetic environment

Neural network intelligent system for the on-line optimization in chemical plants

Optimizing MapReduce for Highly Distributed Environments

Application of Neural Network in Optimization of Chemical Process

Fuzzy Method and Neural Network Model Parallel Implementation of Multi-Layer Neural Network Based on Cloud Computing for Real Time Data Transmission in Large Offshore Platform

An efficient data generation method for ANN-based surrogate models