Abstract:The capability for environmental sound recognition (ESR) can determine the fitness of individuals in a way to avoid dangers or pursue opportunities when critical sound events occur. It still remains mysterious about the fundamental principles of biological systems that result in such a remarkable ability. Additionally, the practical importance of ESR has attracted an increasing amount of research attention, but the chaotic and nonstationary difficulties continue to make it a challenging task. In this article, we propose a spike-based framework from a more brain-like perspective for the ESR task. Our framework is a unifying system with consistent integration of three major functional parts which are sparse encoding, efficient learning, and robust readout. We first introduce a simple sparse encoding, where key points are used for feature representation, and demonstrate its generalization to both spike- and nonspike-based systems. Then, we evaluate the learning properties of different learning rules in detail with our contributions being added for improvements. Our results highlight the advantages of multispike learning, providing a selection reference for various spike-based developments. Finally, we combine the multispike readout with the other parts to form a system for ESR. Experimental results show that our framework performs the best as compared to other baseline approaches. In addition, we show that our spike-based framework has several advantageous characteristics including early decision making, small dataset acquiring, and ongoing dynamic processing. Our framework is the first attempt to apply the multispike characteristic of nervous neurons to ESR. The outstanding performance of our approach would potentially contribute to draw more research efforts to push the boundaries of spike-based paradigm to a new horizon.

Unsupervised AER Object Recognition Based on Multiscale Spatio-Temporal Features and Spiking Neurons

An Event-Driven Object Recognition Model Using Activated Connected Domain Detection

An Event-Driven Computational System With Spiking Neurons For Object Recognition

Effective AER Object Classification Using Segmented Probability-Maximization Learning in Spiking Neural Networks

An Event-Driven Categorization Model for AER Image Sensors Using Multispike Encoding and Learning

A Bio-Inspired Hierarchical Spiking Neural Network With Reward-Modulated STDP Learning Rule for AER Object Recognition

An Event-based Categorization Model Using Spatio-temporal Features in a Spiking Neural Network.

Recognition for AER Objects Based on Hierarchical Feature Construction

An Event-based Feature Representation Method for Event Stream Classification Using Deep Spiking Neural Networks

Event-based Action Recognition Using Motion Information and Spiking Neural Networks

Recognizing Scoring in Basketball Game from AER Sequence by Spiking Neural Networks.

Feedforward Categorization on AER Motion Events Using Cortex-Like Features in a Spiking Neural Network

A Gesture Recognition Method Based On Spiking Neural Networks For Cognition Development

EventF2S: Asynchronous and Sparse Spiking AER Framework using Neuromorphic-Friendly Algorithm

Event-driven Spiking Neural Networks with Spike-Based Learning

Unsupervised Spiking Instance Segmentation on Event Data using STDP

Spiking Neural Network Recognition Method Based on Dynamic Visual Motion Features

Sparse Temporal Encoding of Visual Features for Robust Object Recognition by Spiking Neurons

Robust Environmental Sound Recognition with Sparse Key-point Encoding and Efficient Multi-spike Learning.

Event Stream Learning Using Spatio-Temporal Event Surface

Event-Based Multimodal Spiking Neural Network with Attention Mechanism