Abstract:The brain's structure and functions have consistently inspired the development of intelligent technologies throughout human history.Brain-inspired spiking neural networks(SNNs)emulate neural dynamics by incorporating event-based computations to capture temporal information,thereby enabling brain-like and energy-efficient computations.Currently,SNNs have been successfully applied in various fields,such as image recognition and object detection,and have the potential to revolutionize the field of artificial intelligence.Similar to the brain,artificial models show emergent properties,such as high performance and intelligence,with sufficiently large size.However,the sizes of SNNs have been limited,which hinders potential performance improvements and thus their real-world application.Therefore,methods and theories for constructing large-scale SNNs must be developed to achieve their highest potential.New techniques for building large-scale SNNs have recently attracted extensive research interest.In this review,notable advances and developments with large-scale SNNs,including spiking neuron,algorithm and model structure designs,software frameworks and neuromorphic computing chips,and neuromorphic applications are summarized.Various strategies including parallel computing,surrogate gradients,and transformer-based SNNs are discussed in detail.Specifically,various types of spiking neurons have been developed,with parametric neurons improving the representation ability of SNNs and parallel spiking neurons accelerating the training process.The direct training method is notable for enabling the training of large-scale SNNs,while brain-inspired methods such as plasticity,attention,and pruning algorithms improve the robustness and energy efficiency of SNNs.The ResNet structure and its variants have led to the development of large-scale SNNs,and the emergence of transformer-based SNNs has significantly improved SNN performance on computer vision tasks.Programming frameworks have evolved from solely supporting the inference of large-scale networks to facilitating training,including automatic differentiation,parallel computation acceleration,and implementation on neuromorphic sensors and chips.Large SNNs are particularly well-suited for processing events/spikes collected by neuromorphic sensors,especially in image reconstruction and object detection,but their development is still in the early stages.Furthermore,existing challenges and deficiencies are discussed,providing guidance for the future development of large-scale SNN models.In summary,brain-inspired designs of models and neuromorphic chips are still limited to simplified simulations,lacking sufficient biological plausibility.The temporal dynamic representation capabilities of SNNs have not yet been fully demonstrated.The computations of large-scale SNNs must be accelerated while reducing their power consumption.Moreover,tasks such as natural language processing,reasoning,and decision-making and computer vision tasks must both be investigated.The problem of efficiently measuring and representing asynchronous spatiotemporal events/spike data remains unresolved,limiting the full potential of existing neuromorphic vision systems.In conclusion,large-scale brain-inspired neural networks can still be substantially improved.Efforts are needed in various research directions,including algorithms,computing frameworks,and architectures,to explore and optimize brain-like models and hardware in a collaborative manner.

Emergence of brain-inspired small-world spiking neural network through neuroevolution

Efficient Structure Slimming for Spiking Neural Networks

Multi-scale Evolutionary Neural Architecture Search for Deep Spiking Neural Networks

Adaptive structure evolution and biologically plausible synaptic plasticity for recurrent spiking neural networks

ESL-SNNs: An Evolutionary Structure Learning Strategy for Spiking Neural Networks

Biologically Inspired Structure Learning with Reverse Knowledge Distillation for Spiking Neural Networks

Evolving Efficient Genetic Encoding for Deep Spiking Neural Networks

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Efficient Spiking Neural Networks with Sparse Selective Activation for Continual Learning

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

Spike Neural Network Learning Algorithm Based on an Evolutionary Membrane Algorithm

Brain-inspired Chaotic Spiking Backpropagation

30.2 A 22nm 0.26nW/Synapse Spike-Driven Spiking Neural Network Processing Unit Using Time-Step-First Dataflow and Sparsity-Adaptive In-Memory Computing

Advanced Computing and Related Applications Leveraging Brain-inspired Spiking Neural Networks

Theories and Methods for Large-Scale Brain-Inspired Neural Networks

Research Advances and New Paradigms for Biology-inspired Spiking Neural Networks

Brain topology improved spiking neural network for efficient reinforcement learning of continuous control

BrainTransformers: SNN-LLM

Event-Driven Learning for Spiking Neural Networks

SPikE-SSM: A Sparse, Precise, and Efficient Spiking State Space Model for Long Sequences Learning