[Frontal tumor revealed by mega-stomach].

P. Gerard,B. Hillemand

1955-06-01

Abstract:

What problem does this paper attempt to address?

Automatic Respiratory Sound Classification Via Multi-Branch Temporal Convolutional Network

Ziping Zhao,Zhen Gong,Mingyue Niu,Jiali Ma,Haishuai Wang,Zixing Zhang,Ya Li

DOI: https://doi.org/10.1109/icassp43922.2022.9746182

2022-01-01

Abstract:Automated classification of respiratory sounds has become an active research area in recent years. While recent studies have utilised deep learning methods to aid with respiratory sound classification, the performance is heavily influenced by the datasets available for respiratory sound classification tasks, which tend to be smaller and imbalanced. In this paper, we propose to explore the effectiveness of a multi-branch Temporal Convolutional Network (TCN) architecture integrated with Squeeze-and-Excitation Network (SEnet), a system denoted herein as MBTCNSE, for respiratory sound classification. To the best of the authors’ knowledge, this is the first time that such a hybrid architecture has been employed for respiratory sounds classification. Experiments based on the ICBHI challenge respiratory sound dataset demonstrate the effectiveness of our method.
Environmental Sound Classification Based on CAR-Transformer Neural Network Model

Huaicheng Li,Aibin Chen,Jizheng Yi,Wenjie Chen,Daowu Yang,Guoxiong Zhou,Weixiong Peng

DOI: https://doi.org/10.1007/s00034-023-02339-w

2023-04-28

Abstract:Environment Sound Classification (ESC) has been a challenging task in the audio field due to the different types of ambient sounds involved. In this paper, we propose a method for the ESC tasks based on the CAR-Transformer neural network model, which includes stages of sound sample pre-processing, deep learning-based feature extraction, and classifier classification. We convert the one-dimensional audio signal into two-dimensional Mel Frequency Cepstral Coefficients (MFCC) and use them as the feature map of the audio. The CAR-Transformer model was used for feature extraction, and after dimensionality reduction of the extracted feature map, we use the fully connected layer as a classifier of the feature map to obtain the final results. The method achieves a classification accuracy of 96.91% on the UrbanSound8K dataset, while the number of parameters in the model is only 0.16 M. The results of this paper were compared with other state-of-art research.

engineering, electrical & electronic
Deep Convolutional Neural Network with Mixup for Environmental Sound Classification

Zhichao Zhang,Shugong Xu,Shan Cao,Shunqing Zhang

DOI: https://doi.org/10.48550/arXiv.1808.08405

2018-08-25

Abstract:Environmental sound classification (ESC) is an important and challenging problem. In contrast to speech, sound events have noise-like nature and may be produced by a wide variety of sources. In this paper, we propose to use a novel deep convolutional neural network for ESC tasks. Our network architecture uses stacked convolutional and pooling layers to extract high-level feature representations from spectrogram-like features. Furthermore, we apply mixup to ESC tasks and explore its impacts on classification performance and feature distribution. Experiments were conducted on UrbanSound8K, ESC-50 and ESC-10 datasets. Our experimental results demonstrated that our ESC system has achieved the state-of-the-art performance (83.7%) on UrbanSound8K and competitive performance on ESC-50 and ESC-10.

Sound,Audio and Speech Processing
Environmental Sound Classification Via Time–Frequency Attention and Framewise Self-Attention-Based Deep Neural Networks

Bo Wu,Xiao-Ping Zhang

DOI: https://doi.org/10.1109/jiot.2021.3098464

IF: 10.6

2022-01-01

IEEE Internet of Things Journal

Abstract:Environmental sound classification (ESC) is crucial to understanding the surroundings in Internet of Things (IoT) applications. The state-of-the-art deep learning approaches do not have good ESC performance when there exists various clutter interference, which is common in IoT scenarios. In this article, we present a novel deep neural network framework based on time-frequency attention and framewise self-attention (TFFS-DNN). It consists of two major novel architectures: 1) gradient and 2) latent feature-based DNN to generate our time-frequency attention, which can locate the relevant time-frequency (i.e., spectral) features accurately, and self-attention normalization DNN to generate our framewise self-attentions which properly indicate the relevance of frames. By conjoining these two sorts of distinct and complementary attentions with spectrograms, we are able to identify the importance or relevance in terms of time, frequency, and frame of the sounds using TFFS-DNN, which helps in distinguishing clutter such as background as well as model interpretation to some extent. Thus, the proposed TFFS-DNN can classify environmental sounds with clutter. The evaluation using four real-world environmental sound data sets demonstrates the superior performance of the proposed framework over several state-of-the-art schemes. Notably, we achieve 79.23% classification accuracy on the UrbanSound data set, a raw environmental sound data set that is full of clutter. The ablation study demonstrates a relative 3%-9% improvement of classification accuracy by the proposed framework over the baseline deep model.
Attention based Convolutional Recurrent Neural Network for Environmental Sound Classification

Zhichao Zhang,Shugong Xu,Tianhao Qiao,Shunqing Zhang,Shan Cao

DOI: https://doi.org/10.48550/arXiv.1907.02230

2019-07-04

Abstract:Environmental sound classification (ESC) is a challenging problem due to the complexity of sounds. The ESC performance is heavily dependent on the effectiveness of representative features extracted from the environmental sounds. However, ESC often suffers from the semantically irrelevant frames and silent frames. In order to deal with this, we employ a frame-level attention model to focus on the semantically relevant frames and salient frames. Specifically, we first propose an convolutional recurrent neural network to learn spectro-temporal features and temporal correlations. Then, we extend our convolutional RNN model with a frame-level attention mechanism to learn discriminative feature representations for ESC. Experiments were conducted on ESC-50 and ESC-10 datasets. Experimental results demonstrated the effectiveness of the proposed method and achieved the state-of-the-art performance in terms of classification accuracy.

Sound,Machine Learning,Audio and Speech Processing
Research on Environmental Sound Recognition Method based on Residual Network with Dual Attention Mechanism

Li Jia,Xiang Sun,Zhengyong Qiu,Meng Sun

DOI: https://doi.org/10.1109/ITAIC58329.2023.10409085

2023-12-08

Abstract:Aiming at the problem that existing deep learning methods pay the same attention to sound features, which leads to low accuracy of environmental sound recognition, a method for environmental sound recognition based on residual network with dual attention mechanism is proposed. Firstly, the log-Mel spectrogram (LM), Mel-scaled frequency cepstral coefficients (MFCC) of the sound signal are extracted, and the two features are fused as inputs to the neural network. Secondly, based on the channel attention mechanism and the spatial attention mechanism, a dual attention mechanism is designed to automatically learn different feature channel weights, so that the model focuses more on the key channel feature information, and at the same time, improves the model's ability to extract features in the time-frequency domain, so as to better capture the sound features and improve the accuracy of sound recognition. Finally, the features are classified using the fully connected layer and softmax output layer to achieve the recognition of different sound signals. The experimental results show that the recognition rate of using fusion features is higher than that of the single feature, and the recognition rate of the proposed model is 95.42 %, which is higher than that of other models and meets the requirements of practical engineering applications.

Computer Science,Environmental Science
Sub-Spectrogram Segmentation for Environmental Sound Classification via Convolutional Recurrent Neural Network and Score Level Fusion

Tianhao Qiao,Shunqing Zhang,Zhichao Zhang,Shan Cao,Shugong Xu

DOI: https://doi.org/10.48550/arXiv.1908.05863

2019-08-16

Abstract:Environmental Sound Classification (ESC) is an important and challenging problem, and feature representation is a critical and even decisive factor in ESC. Feature representation ability directly affects the accuracy of sound classification. Therefore, the ESC performance is heavily dependent on the effectiveness of representative features extracted from the environmental sounds. In this paper, we propose a subspectrogram segmentation based ESC classification framework. In addition, we adopt the proposed Convolutional Recurrent Neural Network (CRNN) and score level fusion to jointly improve the classification accuracy. Extensive truncation schemes are evaluated to find the optimal number and the corresponding band ranges of sub-spectrograms. Based on the numerical experiments, the proposed framework can achieve 81.9% ESC classification accuracy on the public dataset ESC-50, which provides 9.1% accuracy improvement over traditional baseline schemes.

Sound,Machine Learning,Audio and Speech Processing
SS-ESC: a spectral subtraction denoising based deep network model on environmental sound classification

Yunus Korkmaz

DOI: https://doi.org/10.1007/s11760-024-03649-5

IF: 1.583

2024-12-05

Signal Image and Video Processing

Abstract:Environmental Sound Classification (ESC), also referred as Sound Event Classification, is an essential part of many speech processing applications in terms of of separating background audio from original signal. By the recent developments in deep learning area, studies related to the ESC area have also been improved significiantly by the researchers. Because the nature of digital sound signals, the ESC was mostly developed using manually extracted one dimensional (1D) so far. In this paper, a novel ESC pipeline which uses spectral subtraction denoising as a preliminary stage was proposed based on deep learning architectures. The well-known deep learning architectures which are GoogLeNet, AlexNet, ShuffleNet, SqueezeNet and ResNet-18 were run over ESC problem by using ESC-10 benchmark dataset. Log-mel spectrogram images were preferred as feature matrices for mentioned networks. The results showed that the proposed SS-ESC model achieved the best results and outperformed many state-of-the-art methods with a test accuracy of 99.17% for the ESC-10 by the help of the AlexNet. These findings significiantly proved that the spectral subtraction denoising can contribute to the environmental sound classification problem in leveraging classification accuracy when it is used as a preliminary stage.

engineering, electrical & electronic,imaging science & photographic technology
Robust Audio Sensing with Multi-Sound Classification.

Peter Haubrick,Juan Ye

DOI: https://doi.org/10.1109/percom.2019.8767402

2019-01-01

Abstract:Audio data is a highly rich form of information, often containing patterns with unique acoustic signatures. In pervasive sensing environments, because of the empowered smart devices, we have witnessed an increasing research interest in sound sensing to detect ambient environment, recognise users’ daily activities, and infer their health conditions. However, the main challenge is that the real-world environment often contains multiple sound sources, which can significantly compromise the robustness of the above environment, event, and activity detection applications. In this paper, we explore different approaches in multi-sound classification, and propose a stacked classifier based on the recent advance in deep learning. We evaluate our proposed approach in a comprehensive set of experiments on both sound effect and real-world datasets. The results have demonstrated that our approach can robustly identify each sound category among mixed acoustic signals, without the need of any a priori knowledge about the number and signature of sounds in the mixed signals.
Environment Sound Classification using Multiple Feature Channels and Attention based Deep Convolutional Neural Network

Jivitesh Sharma,Ole-Christoffer Granmo,Morten Goodwin

DOI: https://doi.org/10.48550/arXiv.1908.11219

2020-12-08

Abstract:In this paper, we propose a model for the Environment Sound Classification Task (ESC) that consists of multiple feature channels given as input to a Deep Convolutional Neural Network (CNN) with Attention mechanism. The novelty of the paper lies in using multiple feature channels consisting of Mel-Frequency Cepstral Coefficients (MFCC), Gammatone Frequency Cepstral Coefficients (GFCC), the Constant Q-transform (CQT) and Chromagram. Such multiple features have never been used before for signal or audio processing. And, we employ a deeper CNN (DCNN) compared to previous models, consisting of spatially separable convolutions working on time and feature domain separately. Alongside, we use attention modules that perform channel and spatial attention together. We use some data augmentation techniques to further boost performance. Our model is able to achieve state-of-the-art performance on all three benchmark environment sound classification datasets, i.e. the UrbanSound8K (97.52%), ESC-10 (95.75%) and ESC-50 (88.50%). To the best of our knowledge, this is the first time that a single environment sound classification model is able to achieve state-of-the-art results on all three datasets. For ESC-10 and ESC-50 datasets, the accuracy achieved by the proposed model is beyond human accuracy of 95.7% and 81.3% respectively.

Sound,Machine Learning,Audio and Speech Processing
Training environmental sound classification models for real-world deployment in edge devices

Manuel Goulão,Lourenço Bandeira,Bruno Martins,Arlindo L. Oliveira

DOI: https://doi.org/10.1007/s42452-024-05803-7

2024-03-28

SN Applied Sciences

Abstract:The interest in smart city technologies has grown in recent years, and a major challenge is to develop methods that can extract useful information from data collected by sensors in the city. One possible scenario is the use of sound sensors to detect passing vehicles, sirens, and other sounds on the streets. However, classifying sounds in a street environment is a complex task due to various factors that can affect sound quality, such as weather, traffic volume, and microphone quality. This paper presents a deep learning model for multi-label sound classification that can be deployed in the real world on edge devices. We describe two key components, namely data collection and preparation, and the methodology to train the model including a pre-train using knowledge distillation. We benchmark our models on the ESC-50 dataset and show an accuracy of 85.4%, comparable to similar state-of-the-art models requiring significantly more computational resources. We also evaluated the model using data collected in the real world by early prototypes of luminaires integrating edge devices, with results showing that the approach works well for most vehicles but has significant limitations for the classes "person" and "bicycle". Given the difference between the benchmarking and the real-world results, we claim that the quality and quantity of public and private data for this type of task is the main limitation. Finally, all results show great benefits in pretraining the model using knowledge distillation.
Environmental Sound Classification Based on Multi-temporal Resolution Convolutional Neural Network Combining with Multi-level Features

Boqing Zhu,Kele Xu,Dezhi Wang,Lilun Zhang,Bo Li,Yuxing Peng

DOI: https://doi.org/10.48550/arXiv.1805.09752

2018-06-14

Abstract:Motivated by the fact that characteristics of different sound classes are highly diverse in different temporal scales and hierarchical levels, a novel deep convolutional neural network (CNN) architecture is proposed for the environmental sound classification task. This network architecture takes raw waveforms as input, and a set of separated parallel CNNs are utilized with different convolutional filter sizes and strides, in order to learn feature representations with multi-temporal resolutions. On the other hand, the proposed architecture also aggregates hierarchical features from multi-level CNN layers for classification using direct connections between convolutional layers, which is beyond the typical single-level CNN features employed by the majority of previous studies. This network architecture also improves the flow of information and avoids vanishing gradient problem. The combination of multi-level features boosts the classification performance significantly. Comparative experiments are conducted on two datasets: the environmental sound classification dataset (ESC-50), and DCASE 2017 audio scene classification dataset. Results demonstrate that the proposed method is highly effective in the classification tasks by employing multi-temporal resolution and multi-level features, and it outperforms the previous methods which only account for single-level features.

Sound,Audio and Speech Processing
Research on Acoustic Events Recognition Method with Dimensionality Reduction Combining Attention and Mutual Information

Haitao Liu,Jiasheng Zhou,Guanglei Xi,Bo Peng,Sheng Zhang,Qian Xiao

DOI: https://doi.org/10.1109/jsen.2022.3155706

IF: 4.3

2022-01-01

IEEE Sensors Journal

Abstract:The environment sound classification(ESC) is of great significance to the monitoring and control of urban noise. Aiming at the curse of dimensionality phenomenon in ESC, a feature dimensionality reduction architecture combining attention and mutual information is proposed. In order to match the two-dimensional MFCC (Mel Frequency Cepstral Coefficients) feature matrix, the proposed method separates and reconstructs the feature frames of different samples, and achieves the effect of dimensionality reduction by making decisions on the information entropy between the feature frames and labels. In addition, the method combines LSTM (Long Short-Term Memory) model with attention mechanism to ensure the recognition accuracy of the model after dimensionality reduction. Ten urban acoustic events from UrbanSound8k (US8K) dataset are selected to verify the performances of the proposed method by simulation experiments, which are also compared with the existing classification methods. The simulation results show that by combining the attention mechanism and mutual information, the recognition accuracy of the proposed method on the UrbanSound8k dataset is 95.16%, and the parameter scale is the smallest, only 0.92M. Moreover, the model parameter scale is adjustable by dynamic frame retention mechanism to balance the recognition accuracy and speed. This method not only ensures a high classification accuracy, but also can reduce computing power consumption and storage space of monitoring equipment, which shows a better practical performance for urban acoustic events recognition.

engineering, electrical & electronic,instruments & instrumentation,physics, applied
Environmental Sound Classification Using Local Binary Pattern and Audio Features Collaboration

Ohini Kafui Toffa,Max Mignotte

DOI: https://doi.org/10.1109/tmm.2020.3035275

IF: 7.3

2021-01-01

IEEE Transactions on Multimedia

Abstract:This paper presents a new approach to classify environmental sounds using a texture feature local binary pattern (LBP) and audio features collaboration. To our knowledge, this is the first time that the LBP (or its variants), which has a proven track record in the field of image recognition and classification, has been generalized for 1D and combined with audio features for an environmental sound classification task. To this end, we have generalized and defined LBP-1D and local phase quantization (LPQ)-1D on the 1-dimensional (1D) audio signal and have applied the original LBP, the variance LBP (VARLBP) and the extended LBP (ELBP) thus generated to the spectrogram of the audio signal in order to model the sound texture. We have also extensively compared these new LBP-based features to the classical audio descriptors commonly used in environmental sound classification, such as MFCC, GFCC, CQT, chromagram, STE and ZCR. We have evaluated our algorithm on ESC-10 and ESC-50 datasets using classical machine learning algorithms, such as support vector machines (SVM), random forest and k-nearest neighbor (kNN). The results showed that the LBP features outperform the classical audio features. We mix the LBP features with the audio descriptors, and our best mixed model achieves state-of-the-art results for environmental sound classification: 88.5<span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0" height="0.343ex" style="vertical-align: -0.171ex;" viewBox="0 -73.8 0 147.5" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"></g></svg></span> on ESC-10 and 64.6<span class="mjpage"><svg xmlns:xlink="http://www.w3.org/1999/xlink" width="0" height="0.343ex" style="vertical-align: -0.171ex;" viewBox="0 -73.8 0 147.5" role="img" focusable="false" xmlns="http://www.w3.org/2000/svg"><g stroke="currentColor" fill="currentColor" stroke-width="0" transform="matrix(1 0 0 -1 0 0)"></g></svg></span> on ESC-50. Those results outperform the results of methods that used handcrafted features with classical machine learning algorithms and are similar to some convolutional neural network-based methods. Although our method is not the cutting edge of the state-of-the-art methods, it is faster than any convolutional neural network methods and represents a better choice when there is data scarcity or minimal computing power.<svg xmlns="http://www.w3.org/2000/svg" style="display: none;"><defs id="MathJax_SVG_glyphs"></defs></svg>

computer science, information systems,telecommunications, software engineering
Feature Pyramid Attention based Residual Neural Network for Environmental Sound Classification

Tin Lun Lam,Liguang Zhou,Xiaonan Qi,Junjie Hu,Yuhongze Zhou,Yangsheng Xu

DOI: https://doi.org/10.48550/arXiv.2205.14411

2022-05-28

Abstract:Environmental sound classiﬁcation (ESC) is a challenging problem due to the unstructured spatial-temporal relations that exist in the sound signals. Re-cently, many studies have focused on abstracting features from convolutional neural networks while the learning of semantically relevant frames of sound signals has been overlooked. To this end, we present an end-to-end framework, namely feature pyramid attention network (FPAM), focusing on abstracting the semantically relevant features for ESC. We ﬁrst extract the feature maps of the preprocessed spectrogram of the sound waveform by a backbone network. Then, to build multi-scale hierarchical features of sound spectrograms, we construct a feature pyramid representation of the sound spectrograms by aggregating the feature maps from multi-scale layers, where the temporal frames and spatial locations of semantically relevant frames are localized by FPAM. Speciﬁcally, the multiple features are ﬁrst processed by a dimension alignment module. Af-terward, the pyramid spatial attention module (PSA) is attached to localize the important frequency regions spatially with a spatial attention module (SAM). Last, the processed feature maps are reﬁned by a pyramid channel attention (PCA) to localize the important temporal frames. To justify the eﬀectiveness of the proposed FPAM, visualization of attention maps on the spectrograms has been presented. The visualization results show that FPAM can focus more on the semantic relevant regions while neglecting the noises. The eﬀectiveness of the proposed methods is validated on two widely used ESC datasets: the ESC-50 and ESC-10 datasets. The experimental results show that the FPAM yields comparable performance to state-of-the-art methods. A substantial performance increase has been achieved by FPAM compared with the baseline methods.

Environmental Science,Engineering,Computer Science
Learning Frame Level Attention for Environmental Sound Classification

Zhichao Zhang,Shugong Xu,Shunqing Zhang,Tianhao Qiao,Shan Cao

DOI: https://doi.org/10.48550/arXiv.2007.07241

2020-07-12

Abstract:Environmental sound classification (ESC) is a challenging problem due to the complexity of sounds. The classification performance is heavily dependent on the effectiveness of representative features extracted from the environmental sounds. However, ESC often suffers from the semantically irrelevant frames and silent frames. In order to deal with this, we employ a frame-level attention model to focus on the semantically relevant frames and salient frames. Specifically, we first propose a convolutional recurrent neural network to learn spectro-temporal features and temporal correlations. Then, we extend our convolutional RNN model with a frame-level attention mechanism to learn discriminative feature representations for ESC. We investigated the classification performance when using different attention scaling function and applying different layers. Experiments were conducted on ESC-50 and ESC-10 datasets. Experimental results demonstrated the effectiveness of the proposed method and our method achieved the state-of-the-art or competitive classification accuracy with lower computational complexity. We also visualized our attention results and observed that the proposed attention mechanism was able to lead the network tofocus on the semantically relevant parts of environmental sounds.

Sound,Audio and Speech Processing
Urban Sound Classification : striving towards a fair comparison

Augustin Arnault,Baptiste Hanssens,Nicolas Riche

DOI: https://doi.org/10.48550/arXiv.2010.11805

2020-10-22

Abstract:Urban sound classification has been achieving remarkable progress and is still an active research area in audio pattern recognition. In particular, it allows to monitor the noise pollution, which becomes a growing concern for large cities. The contribution of this paper is two-fold. First, we present our DCASE 2020 task 5 winning solution which aims at helping the monitoring of urban noise pollution. It achieves a macro-AUPRC of 0.82 / 0.62 for the coarse / fine classification on validation set. Moreover, it reaches accuracies of 89.7% and 85.41% respectively on ESC-50 and US8k datasets. Second, it is not easy to find a fair comparison and to reproduce the performance of existing models. Sometimes authors copy-pasting the results of the original papers which is not helping reproducibility. As a result, we provide a fair comparison by using the same input representation, metrics and optimizer to assess performances. We preserve data augmentation used by the original papers. We hope this framework could help evaluate new architectures in this field. For better reproducibility, the code is available on our GitHub repository.

Sound,Machine Learning,Audio and Speech Processing
Artificial intelligence-based collaborative acoustic scene and event classification to support urban soundscape analysis and classification

Yuanbo Hou,Dick Botteldooren

DOI: https://doi.org/10.3397/in_2022_0974

2023-02-01

INTER-NOISE and NOISE-CON Congress and Conference Proceedings

Abstract:A human listener embedded in a sonic environment will rely on meaning given to sound events as well as on general acoustic features to analyse and appraise its soundscape. However, currently used measurable indicators for soundscape mainly focus on the latter and meaning is only included indirectly. Yet, today's artificial intelligence (AI) techniques allow to recognise a variety of sounds and thus assign meaning to them. Hence, we propose to combine a model for acoustic event classification trained on the large-scale environmental sound database AudioSet, with a scene classification algorithm that couples direct identification of acoustic features with these recognised sound for scene recognition. The combined model is trained on TUT2018, a database containing ten everyday scenes. Applying the resulting AI-model to the soundscapes of the world database without further training shows that the classification that is obtained correlates to perceived calmness and liveliness evaluated by a test panel. It also allows to unravel why an acoustic environment sounds like a lively square or a calm park by analysing the type of sounds and their occurrence pattern over time. Moreover, disturbance of the acoustic environment that is expected based on visual clues, by e.g. traffic can easily be recognised.
Rethinking environmental sound classification using convolutional neural networks: optimized parameter tuning of single feature extraction

Yousef Abd Al-Hattab,Hasan Firdaus Zaki,Amir Akramin Shafie

DOI: https://doi.org/10.1007/s00521-021-06091-7

2021-05-26

Neural Computing and Applications

Abstract:The classification of environmental sounds is important for emerging applications such as automatic audio surveillance, audio forensics, and robot navigation. Existing techniques combined multiple features and stacked many CNN layers (very deep learning) to reach the desired accuracy. Instead of using many features and going deeper by stacking layers that are resource extensive, this paper proposes a novel technique that uses only a single feature, namely the Mel-Frequency Cepstral Coefficient (MFCC) and just three layers of CNN. We demonstrate that such a simple network can considerably outperform several conventional and deep learning-based algorithms. Through parameters fine-tuning of the data input, we reported a model that is significantly less complex in the architecture yet has recorded a similar accuracy of 95.59% compared to state-of-the-art deep models on UrbanSound8k dataset.

computer science, artificial intelligence
SoundCLR: Contrastive Learning of Representations For Improved Environmental Sound Classification

Alireza Nasiri,Jianjun Hu

DOI: https://doi.org/10.48550/arXiv.2103.01929

2021-03-02

Sound

Abstract:Environmental Sound Classification (ESC) is a challenging field of research in non-speech audio processing. Most of current research in ESC focuses on designing deep models with special architectures tailored for specific audio datasets, which usually cannot exploit the intrinsic patterns in the data. However recent studies have surprisingly shown that transfer learning from models trained on ImageNet is a very effective technique in ESC. Herein, we propose SoundCLR, a supervised contrastive learning method for effective environment sound classification with state-of-the-art performance, which works by learning representations that disentangle the samples of each class from those of other classes. Our deep network models are trained by combining a contrastive loss that contributes to a better probability output by the classification layer with a cross-entropy loss on the output of the classifier layer to map the samples to their respective 1-hot encoded labels. Due to the comparatively small sizes of the available environmental sound datasets, we propose and exploit a transfer learning and strong data augmentation pipeline and apply the augmentations on both the sound signals and their log-mel spectrograms before inputting them to the model. Our experiments show that our masking based augmentation technique on the log-mel spectrograms can significantly improve the recognition performance. Our extensive benchmark experiments show that our hybrid deep network models trained with combined contrastive and cross-entropy loss achieved the state-of-the-art performance on three benchmark datasets ESC-10, ESC-50, and US8K with validation accuracies of 99.75\%, 93.4\%, and 86.49\% respectively. The ensemble version of our models also outperforms other top ensemble methods. The code is available at https://github.com/alireza-nasiri/SoundCLR.

[Frontal tumor revealed by mega-stomach].

Automatic Respiratory Sound Classification Via Multi-Branch Temporal Convolutional Network

Environmental Sound Classification Based on CAR-Transformer Neural Network Model

Deep Convolutional Neural Network with Mixup for Environmental Sound Classification

Environmental Sound Classification Via Time–Frequency Attention and Framewise Self-Attention-Based Deep Neural Networks

Attention based Convolutional Recurrent Neural Network for Environmental Sound Classification

Research on Environmental Sound Recognition Method based on Residual Network with Dual Attention Mechanism

Sub-Spectrogram Segmentation for Environmental Sound Classification via Convolutional Recurrent Neural Network and Score Level Fusion

SS-ESC: a spectral subtraction denoising based deep network model on environmental sound classification

Robust Audio Sensing with Multi-Sound Classification.

Environment Sound Classification using Multiple Feature Channels and Attention based Deep Convolutional Neural Network

Training environmental sound classification models for real-world deployment in edge devices

Environmental Sound Classification Based on Multi-temporal Resolution Convolutional Neural Network Combining with Multi-level Features

Research on Acoustic Events Recognition Method with Dimensionality Reduction Combining Attention and Mutual Information

Environmental Sound Classification Using Local Binary Pattern and Audio Features Collaboration

Feature Pyramid Attention based Residual Neural Network for Environmental Sound Classification

Learning Frame Level Attention for Environmental Sound Classification

Urban Sound Classification : striving towards a fair comparison

Artificial intelligence-based collaborative acoustic scene and event classification to support urban soundscape analysis and classification

Rethinking environmental sound classification using convolutional neural networks: optimized parameter tuning of single feature extraction

SoundCLR: Contrastive Learning of Representations For Improved Environmental Sound Classification