Abstract:Deep learning's performance on the imbalanced small data is substantially degraded by overfitting. Recurrent neural networks retain better performance in such tasks by constructing dynamical systems for robustness. Synergetic neural network (SNN), a synergetic-based recurrent neural network, has superiorities in eliminating recall errors and pseudo memories, but is subject to frequent association errors. Since the cause remains unclear, most subsequent studies use genetic algorithms to adjust parameters for better accuracy, which occupies the parameter optimization space and hinders task-oriented tuning. To solve the problem and promote SNN's application capability, we propose the modern synergetic neural network (MSNN) model. MSNN solves the association error by correcting the state initialization method in the working process, liberating the parameter optimization space. In addition, MSNN optimizes the attention parameter of the network with the error backpropagation algorithm and the gradient bypass technique to allow the network to be trained jointly with other network layers. The self-learning of the attention parameter empowers the adaptation to the imbalanced sample size, further improving the classification performance. In 75 classification tasks of small UC Irvine Machine Learning Datasets, the average rank of the MSNN achieves the best result compared to 187 neural and non-neural network machine learning methods.

Immunity clonal synergetic learning of unbalanced attention parameters in synergetic network

Kernel-based Immunity Synergetic Network for Image Classification

Reconstruction Of Order Parameters Based On Immunity Clonal Strategy For Image Classification

An Immune Clonal Selection Network and Its Learning Algorithm

Robust Classification Of Immunity Clonal Synergetic Network Inspired By Fuzzy Integral

An Effective Learning Algorithm of Synergetic Neural Network

Immune clonal selection network

Immunity Clonal Strategies

Concentration or Distraction? A Synergetic-Based Attention Weights Optimization Method

Method to Reduce Over-Segmentation of Images Using Immune Clonal Algorithm

An artificial neural network on chaotic immune evolutionary algorithm

An Artificial Neural Network Based on CIEA

Modern synergetic neural network for imbalanced small data classification

Parameters optimization of synergetic neural network

A New Artificial Immune Algorithm Based On Immune Network

An Improved Immune Algorithm and Its Evaluation of Optimization Efficiency.

Immune Clonal Selection Network Clustering Algorithm and its Application to Fault Diagnosis

IMMUNE MODULATED SYMBIONTIC EVOLUTION IN NEURAL NETWORK DESIGN

Adaptive immune clonal strategy algorithm

Immunity poly-clonal strategies

A Modified Immune Optimization Algorithm