Abstract:The capability for environmental sound recognition (ESR) can determine the fitness of individuals in a way to avoid dangers or pursue opportunities when critical sound events occur. It still remains mysterious about the fundamental principles of biological systems that result in such a remarkable ability. Additionally, the practical importance of ESR has attracted an increasing amount of research attention, but the chaotic and nonstationary difficulties continue to make it a challenging task. In this article, we propose a spike-based framework from a more brain-like perspective for the ESR task. Our framework is a unifying system with consistent integration of three major functional parts which are sparse encoding, efficient learning, and robust readout. We first introduce a simple sparse encoding, where key points are used for feature representation, and demonstrate its generalization to both spike- and nonspike-based systems. Then, we evaluate the learning properties of different learning rules in detail with our contributions being added for improvements. Our results highlight the advantages of multispike learning, providing a selection reference for various spike-based developments. Finally, we combine the multispike readout with the other parts to form a system for ESR. Experimental results show that our framework performs the best as compared to other baseline approaches. In addition, we show that our spike-based framework has several advantageous characteristics including early decision making, small dataset acquiring, and ongoing dynamic processing. Our framework is the first attempt to apply the multispike characteristic of nervous neurons to ESR. The outstanding performance of our approach would potentially contribute to draw more research efforts to push the boundaries of spike-based paradigm to a new horizon.

Robust Sensory Information Reconstruction and Classification With Augmented Spikes

Robust Transcoding Sensory Information with Neural Spikes

Hierarchical Spiking-Based Model for Efficient Image Classification with Enhanced Feature Extraction and Encoding.

CSNN: an Augmented Spiking Based Framework with Perceptron-Inception

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

A Multi-Spike Approach For Robust Sound Recognition

A Spiking Neural Network System for Robust Sequence Recognition

CMCI: A Robust Multimodal Fusion Method for Spiking Neural Networks

A Spike-Timing Based Integrated Model for Pattern Recognition

Deep CovDenseSNN: A Hierarchical Event-Driven Dynamic Framework with Spiking Neurons in Noisy Environment

Spiking-timing based pattern recognition with real-world visual stimuli

Toward Efficient Processing and Learning with Spikes: New Approaches for Multispike Learning

Event-Based Multimodal Spiking Neural Network with Attention Mechanism

Robust Environmental Sound Recognition with Sparse Key-point Encoding and Efficient Multi-spike Learning.

Pattern Recognition of Spiking Neural Networks Based on Visual Mechanism and Supervised Synaptic Learning

A Brain-Inspired Spiking Neural Network Model with Temporal Encoding and Learning

Rapid Feedforward Computation by Temporal Encoding and Learning with Spiking Neurons

Motorsrnn: A Spiking Recurrent Neural Network Inspired by Brain Topology for the Effective and Efficient Decoding of Cortical Spike Trains

Reconstruction of Visual Image from Functional Magnetic Resonance Imaging Using Spiking Neuron Model

An Event-Driven Categorization Model for AER Image Sensors Using Multispike Encoding and Learning

Efficient learning with augmented spikes: A case study with image classification