Abstract:Plastic changes with intrinsic dynamics in synaptic efficacy underlie the cellular level of expression of brain functions regarding multimodal information processing. Among diverse plasticity mechanisms, synaptic scaling exerts indispensable effects on the homeostatic state maintenance and synaptic strength regulation in biological neural networks. Despite recent tremendous progress in developing spiking neural networks (SNNs) for multiple complex scenarios, most of the work remains in the pure backpropagation-based framework where the synaptic scaling mechanism is rarely effectively incorporated. In this work, we present a biologically inspired neuronal model with an activity-dependent adaptive synaptic scaling mechanism that endows each synapse with both short-term enhancement and depression properties. The learning process is completed in two phases. Firstly, in the forward conduction circuits, adaptive short-term enhancement or depression response is triggered in the light of afferent stimuli intensity; Then long-term consolidation is executed by back-propagated error signals. These processes dramatically shape the pattern selectivity of synapses and the diverse information transfer they mediate. Experiments reveal remarkable advantages in three tasks regarding bimodal learning. Specifically, On the continual learning and perturbation-resistant task for Dynamic Vision Sensor (DVS) modal information, our method improves the mean accuracy on the benchmark of N-MNIST dataset than the baseline by and , respectively. On sequence learning task for Active Pixel Sensor (APS) model information, our method improve the generalization capability and training stability by a large margin. These results demonstrate favourable effectiveness of such non-parametric adaptive strategy on bimodal information inference for APS and DVS, facilitating intelligence understanding and bio-inspired modelling.

Neurons With Captive Synaptic Devices for Temperature Robust Spiking Neural Networks

Spiking Neural Network (SNN) With Memristor Synapses Having Non-linear Weight Update

Adaptive Synaptic Adjustment Mechanism to Improve Learning Performances of Spiking Neural Networks

Adaptive Synaptic Scaling in Spiking Networks for Continual Learning and Enhanced Robustness

A Self-Calibratable Spiking Neuron Based on Dual-Mode Memritor for High-Accuracy Spiking Neural Networks

A Memristor-Based Spiking Neural Network With High Scalability and Learning Efficiency

One Transistor One Electrolyte-Gated Transistor for Supervised Learning in SNNs

Enhancing Robustness of Memristor Crossbar‐Based Spiking Neural Networks against Nonidealities: A Hybrid Approach for Neuromorphic Computing in Noisy Environments

30.2 A 22nm 0.26nW/Synapse Spike-Driven Spiking Neural Network Processing Unit Using Time-Step-First Dataflow and Sparsity-Adaptive In-Memory Computing

Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors

A A 22nm 0.43pj/sop Sparsity-Aware In-Memory Neuromorphic Computing System with Hybrid Spiking and Artificial Neural Network and Configurable Topology

Endowing Spiking Neural Networks with Homeostatic Adaptivity for APS-DVS Bimodal Scenarios

Spiking Neural Network with RRAM: Can We Use It for Real-World Application?

Gliotoxin analogues as inhibitors of reverse transcriptase. 2. Resolution and X-ray crystal structure determination.

Highly Linear Analog Spike Processing Block Integrated With an AND-Type Flash Array and CMOS Neuron Circuits

CIRM-SNN: Certainty Interval Reset Mechanism Spiking Neuron for Enabling High Accuracy Spiking Neural Network

Autaptic Synaptic Circuit Enhances Spatio-temporal Predictive Learning of Spiking Neural Networks

Noise-Robust Deep Spiking Neural Networks with Temporal Information

A Low-Cost Hardware-Friendly Spiking Neural Network Based on Binary MRAM Synapses, Accelerated Using In-Memory Computing

Ultra-low Latency Spiking Neural Networks with Spatio-Temporal Compression and Synaptic Convolutional Block

Design of All-Phase-change-memory Spiking Neural Network Enabled by Ge-Ga-Sb Compound