Abstract:Airborne speech enhancement is always a major challenge for the security of airborne systems. Recently, multi-objective learning technology has become one of the mainstream methods of monaural speech enhancement. In this paper, we propose a novel multi-objective method for airborne speech enhancement, called the stacked multiscale densely connected temporal convolutional attention network (SMDTANet). More specifically, the core of SMDTANet includes three parts, namely a stacked multiscale feature extractor, a triple-attention-based temporal convolutional neural network (TA-TCNN), and a densely connected prediction module. The stacked multiscale feature extractor is leveraged to capture comprehensive feature information from noisy log-power spectra (LPS) inputs. Then, the TA-TCNN adopts a combination of these multiscale features and noisy amplitude modulation spectrogram (AMS) features as inputs to improve its powerful temporal modeling capability. In TA-TCNN, we integrate the advantages of channel attention, spatial attention, and T-F attention to design a novel triple-attention module, which can guide the network to suppress irrelevant information and emphasize informative features of different views. The densely connected prediction module is used to reliably control the flow of the information to provide an accurate estimation of clean LPS and the ideal ratio mask (IRM). Moreover, a new joint-weighted (JW) loss function is constructed to further improve the performance without adding to the model complexity. Extensive experiments on real-world airborne conditions show that our SMDTANet can obtain an on-par or better performance compared to other reference methods in terms of all the objective metrics of speech quality and intelligibility.

Multi-layer Attention Mechanism for Speech Keyword Recognition

Effective Combination of DenseNet and BiLSTM for Keyword Spotting.

Multi-task Deep Cross-Attention Networks for Far-Field Speaker Verification and Keyword Spotting

Investigation of Attention Mechanism for Speech Command Recognition

Multi-Modal Attention Mechanisms In Lstm And Its Application To Acoustic Scene Classification

Multi-Stride Self-Attention for Speech Recognition

Multi-layer Attention Mechanism Based Speech Separation Model.

Speech Emotion Recognition Using Multihead Attention in Both Time and Feature Dimensions

Monaural Multi-Talker Speech Recognition With Attention Mechanism And Gated Convolutional Networks

Multi-Task Learning and Weighted Cross-Entropy for DNN-Based Keyword Spotting

Learning Contextual Representation with Convolution Bank and Multi-head Self-attention for Speech Emphasis Detection.

Keyword Guided Target Speech Recognition

A Multimodal Target Speech Extraction Algorithm Based on Long Short Term Attention Mechanism

Voice Keyword Retrieval Method Using Attention Mechanism and Multimodal Information Fusion

A stacked convolutional neural network framework with multi-scale attention mechanism for text-independent voiceprint recognition

Speech Emotion Recognition Via Multi-Level Attention Network

A hybrid CTC+Attention model based on end-to-end framework for multilingual speech recognition

A neural attention model for speech command recognition

Stacked Multiscale Densely Connected Temporal Convolutional Attention Network for Multi-Objective Speech Enhancement in an Airborne Environment

A Spatiotemporal Multi-Stream Learning Framework Based on Attention Mechanism for Automatic Modulation Recognition

Separable Temporal Convolution plus Temporally Pooled Attention for Lightweight High-performance Keyword Spotting