Abstract:By exploiting discrete signal processing and simulating brain neuron communication, Spiking Neural Networks (SNNs) offer a low-energy alternative to Artificial Neural Networks (ANNs). However, existing SNN models, still face high computational costs due to the numerous time steps as well as network depth and scale. The tens of billions of neurons and trillions of synapses in the human brain are developed from only 20,000 genes, which inspires us to design an efficient genetic encoding strategy that dynamic evolves to regulate large-scale deep SNNs at low cost. Therefore, we first propose a genetically scaled SNN encoding scheme that incorporates globally shared genetic interactions to indirectly optimize neuronal encoding instead of weight, which obviously brings about reductions in parameters and energy consumption. Then, a spatio-temporal evolutionary framework is designed to optimize the inherently initial wiring rules. Two dynamic regularization operators in the fitness function evolve the neuronal encoding to a suitable distribution and enhance information quality of the genetic interaction respectively, substantially accelerating evolutionary speed and improving efficiency. Experiments show that our approach compresses parameters by approximately 50\% to 80\%, while outperforming models on the same architectures by 0.21\% to 4.38\% on CIFAR-10, CIFAR-100 and ImageNet. In summary, the consistent trends of the proposed genetically encoded spatio-temporal evolution across different datasets and architectures highlight its significant enhancements in terms of efficiency, broad scalability and robustness, demonstrating the advantages of the brain-inspired evolutionary genetic coding for SNN optimization.

Evolving Feedforward Artificial Neural Networks Using a Two-Stage Approach

A Mixed-Coding Adaptive Differential Evolution For Optimising The Architecture And Parameters Of Feedforward Neural Networks

Anefficient Learning Algorithm For Binary Feedforward Neural Networks

ODE-LM: A Hybrid Training Algorithm for Feedforward Neural Networks

An Evolved Recurrent Neural Network and Its Application

Evolving Deep Neural Networks via Cooperative Coevolution With Backpropagation

Ensemble Structure of Evolutionary Artificial Neural Networks

Optimizing Feed-Forward Neural Networks Using Cascaded Genetic Algorithm

Neuroevolution of Recurrent Architectures on Control Tasks

Evolving activation dynamics in feedforward neural networks

Evolutionary neural networks for deep learning: a review

A Collective Intelligence Based Differential Evolution Algorithm for Optimizing the Structure and Parameters of a Neural Network.

Developing Convolutional Neural Networks using a Novel Lamarckian Co-Evolutionary Algorithm

A New Evolutionary System for Evolving Artificial Neural Networks

NeuroLGP-SM: Scalable Surrogate-Assisted Neuroevolution for Deep Neural Networks

DECN: Evolution Inspired Deep Convolution Network for Black-box Optimization

A Gradient-Guided Evolutionary Approach to Training Deep Neural Networks

Optimization of Neural Network Based on Cooperative Co-Evolutionary Algorithm

Evolving Efficient Genetic Encoding for Deep Spiking Neural Networks

DECN: Automated Evolutionary Algorithms Via Evolution Inspired Deep Convolution Network

A Genetic-Algorithm-based Two-Stage Learning Scheme for Neural Networks