Abstract:Traditional neural networks employ fixed weights during inference, limiting their ability to adapt to changing input conditions, unlike biological neurons that adjust signal strength dynamically based on stimuli. This discrepancy between artificial and biological neurons constrains neural network flexibility and adaptability. To bridge this gap, we propose a novel framework for adaptive neural networks, where neuron weights are modeled as functions of the input signal, allowing the network to adjust dynamically in real-time. Importantly, we achieve this within the same traditional architecture of an Artificial Neural Network, maintaining structural familiarity while introducing dynamic adaptability. In our research, we apply Chebyshev polynomials as one of the many possible decomposition methods to achieve this adaptive weighting mechanism, with polynomial coefficients learned during training. Out of the 145 datasets tested, our adaptive Chebyshev neural network demonstrated a marked improvement over an equivalent MLP in approximately 8\% of cases, performing strictly better on 121 datasets. In the remaining 24 datasets, the performance of our algorithm matched that of the MLP, highlighting its ability to generalize standard neural network behavior while offering enhanced adaptability. As a generalized form of the MLP, this model seamlessly retains MLP performance where needed while extending its capabilities to achieve superior accuracy across a wide range of complex tasks. These results underscore the potential of adaptive neurons to enhance generalization, flexibility, and robustness in neural networks, particularly in applications with dynamic or non-linear data dependencies.

Improve Feed-Forward Neural Network for Weights Direct Determination: a Jacobi-Polynomial Example

Improved BP algorithm for neural network and its application in welding process control

Dynamic node creation and fast learning algorithm for a hybrid feedforward neural network

Fast Algorithm for Adaptive Generalized Predictive Control Based on Bp Neural Networks

Evolving Neural Networks Using the Hybrid of Ant Colony Optimization and Bp Algorithms

Fourier Neural Network Circuit Implementation Based on Direct Weight Determination

Optimal parameters selection of back propagation algorithm in the feedforward neural network

Application of the Improved BP Neural Network in Ship and Ocean Engineering

A Gegenbauer Neural Network with Regularized Weights Direct Determination for Classification

An improved asynchronous batch gradient method for ridge polynomial neural network

Research of New Learning Method of Feedforward Neural Network

A Pseudoinversion-Free Method for Weight Updating in Broad Learning System

A Closed-form Solution for Weight Optimization in Fully-connected Feed-forward Neural Networks

Towards a mathematical framework to inform neural network modelling via polynomial regression

Research on the Inverse Kinematics Prediction of a Soft Biomimetic Actuator via BP Neural Network

Bio-Inspired Adaptive Neurons for Dynamic Weighting in Artificial Neural Networks

A mathematical framework for improved weight initialization of neural networks using Lagrange multipliers

Fast Learning Algorithms for Feedforward Neural Networks

Power-Enhanced Residual Network for Function Approximation and Physics-Informed Inverse Problems

An Improved Neural Network Algorithm for Energy Consumption Forecasting

Research and application on improved BP neural network algorithm