Abstract:This paper presents a new approach to classify environmental sounds using a texture feature local binary pattern (LBP) and audio features collaboration. To our knowledge, this is the first time that the LBP (or its variants), which has a proven track record in the field of image recognition and classification, has been generalized for 1D and combined with audio features for an environmental sound classification task. To this end, we have generalized and defined LBP-1D and local phase quantization (LPQ)-1D on the 1-dimensional (1D) audio signal and have applied the original LBP, the variance LBP (VARLBP) and the extended LBP (ELBP) thus generated to the spectrogram of the audio signal in order to model the sound texture. We have also extensively compared these new LBP-based features to the classical audio descriptors commonly used in environmental sound classification, such as MFCC, GFCC, CQT, chromagram, STE and ZCR. We have evaluated our algorithm on ESC-10 and ESC-50 datasets using classical machine learning algorithms, such as support vector machines (SVM), random forest and k-nearest neighbor (kNN). The results showed that the LBP features outperform the classical audio features. We mix the LBP features with the audio descriptors, and our best mixed model achieves state-of-the-art results for environmental sound classification: 88.5<span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0" height="0.343ex" style="vertical-align: -0.171ex;" viewBox="0 -73.8 0 147.5" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"></g></svg></span> on ESC-10 and 64.6<span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0" height="0.343ex" style="vertical-align: -0.171ex;" viewBox="0 -73.8 0 147.5" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"></g></svg></span> on ESC-50. Those results outperform the results of methods that used handcrafted features with classical machine learning algorithms and are similar to some convolutional neural network-based methods. Although our method is not the cutting edge of the state-of-the-art methods, it is faster than any convolutional neural network methods and represents a better choice when there is data scarcity or minimal computing power.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"></defs></svg>

Environmental Sound Classification Based on Pitch Shifting

Environmental Sound Classification Based on Adding Noise

Environmental Sound Classification Algorithm Based on Adaptive Data Padding

An Automatic Classification System for Environmental Sound in Smart Cities

Environmental Sound Classification Based on Transfer-Learning Techniques with Multiple Optimizers

Deep Convolutional Neural Network with Mixup for Environmental Sound Classification

Environmental Sound Classification Based on CAR-Transformer Neural Network Model

Environmental Sound Classification Framework Based on L-mHP Features and SE-ResNet50 Network Model

Attention based Convolutional Recurrent Neural Network for Environmental Sound Classification

Environment Sound Event Classification with a Two-Stream Convolutional Neural Network

Environment Sound Classification Using A Two-Stream Cnn Based On Decision-Level Fusion

Deep Convolutional Neural Network with Transfer Learning for Environmental Sound Classification

Sub-Spectrogram Segmentation for Environmental Sound Classification via Convolutional Recurrent Neural Network and Score Level Fusion

SS-ESC: a spectral subtraction denoising based deep network model on environmental sound classification

Environmental Sound Classification Using Local Binary Pattern and Audio Features Collaboration

Environment Sound Classification Based On Visual Multi-Feature Fusion And Gru-Aws

Environmental Sound Classification Based on Multi-temporal Resolution Convolutional Neural Network Combining with Multi-level Features

SoundCLR: Contrastive Learning of Representations For Improved Environmental Sound Classification

Rethinking environmental sound classification using convolutional neural networks: optimized parameter tuning of single feature extraction

Environmental Sound Classification Via Time–Frequency Attention and Framewise Self-Attention-Based Deep Neural Networks

Feature Pyramid Attention based Residual Neural Network for Environmental Sound Classification