A chaotic spiking backpropagation approach to brain learning

Guanrong Chen
DOI: https://doi.org/10.1093/nsr/nwae070
IF: 20.6
2024-03-04
National Science Review
Abstract:A highlight of the chaotic spiking backpropagation (CSBP) method, which is a powerful tool for directly training spiking neural networks and helps to understand the learning mechanisms of human brain.
multidisciplinary sciences
What problem does this paper attempt to address?
The problem that this paper attempts to solve is the technical challenges encountered in the training process of existing Spiking Neural Networks (SNNs), especially how to avoid the local minimum problem during the training process. Due to their energy - efficiency advantages, SNNs are regarded as a potential solution to the high - energy - consumption problem of current Artificial Neural Networks (ANNs). However, effective SNNs training methods still face great challenges. In particular, although surrogate - gradient - based methods provide a feasible solution, these methods are prone to make SNNs fall into local minima, which limits their performance and application scope. To solve these problems, Chen's research team introduced a new training method - Chaotic Spiking Backpropagation (CSBP). Inspired by the chaotic dynamics observed in the brain's learning process, this method simulates brain - like chaotic dynamics by introducing specific terms in the loss function, and utilizes its ergodicity and pseudo - random properties to enhance the effectiveness and robustness of SNNs learning. The CSBP method not only improves the training effect of SNNs, but also provides a new perspective for understanding the learning mechanism of the human brain. Specifically, CSBP has the following key features: 1. **Intrinsically integrates chaotic dynamics inspired by the animal brain**: This enables CSBP to simulate dynamic behaviors closer to real biological nervous systems. 2. **Theoretically guarantees global search ability and convergence**: It helps to avoid the local minimum problem common in traditional methods. 3. **Surpasses the existing state - of - the - art methods**: It performs well on a variety of datasets, including neuromorphic datasets (such as DVS - CIFAR10 and DVS - Gesture) and large - scale static datasets (such as ImageNet and CIFAR100). 4. **Functions as an additional module or plug - in**: It can enhance the performance of any existing method by simply introducing a term without changing the parameters of the original method. 5. **Is robust to initial conditions and hyper - parameters**: It effectively alleviates the local minimum trap problem common in existing methods. In summary, the main objective of this paper is to propose a new SNNs training method, improve the learning efficiency and robustness of SNNs by introducing chaotic dynamics, and at the same time provide new theoretical support for understanding the brain learning mechanism.