Abstract:Multi-channel speech enhancement has become an active area of research, demonstrating excellent performance in recovering desired speech signals from noisy environments. Recent approaches have increasingly focused on leveraging spectral information from multi-channel inputs, yielding promising results. In this study, we propose a novel feature integration network that not only captures spectral information but also refines it through shifted-window-based self-attention, enhancing the quality and precision of the feature extraction. Our network consists of blocks containing a full- and sub-band LSTM module for capturing spectral information, and a global–local attention fusion module for refining this information. The full- and sub-band LSTM module integrates both full-band and sub-band information through two LSTM layers, while the global–local attention fusion module learns global and local attention in a dual-branch architecture. To further enhance the feature integration, we fuse the outputs of these branches using a spatial attention module. The model is trained to predict the complex ratio mask (CRM), thereby improving the quality of the enhanced signal. We conducted an ablation study to assess the contribution of each module, with each showing a significant impact on performance. Additionally, our model was trained on the SPA-DNS dataset using a circular microphone array and the Libri-wham dataset with a linear microphone array, achieving competitive results compared to state-of-the-art models.

Multi-feature Combination for Speaker Recognition

Multi-resolution Time Frequency Feature and Complementary Combination for Short Utterance Speaker Recognition

Variant Time-Frequency Cepstral Features for Speaker Recognition

Combining Speech Enhancement and Discriminative Feature Extraction for Robust Speaker Recognition

On the Usage of Multi-Feature Integration for Speaker Verification and Language Identification.

A Combined Feature Approach for Speaker Segmentation Using Convolution Neural Network.

Short Utterance Speaker Recognition Based on Speech High Frequency Information Compensation and Dynamic Feature Enhancement Methods

Methods of Combining Multiple Classifiers with Different Features and Their Applications to Text-Independent Speaker Identification

Speaker Recognition Using DMFCC over Telephone Channels

Combining Information from Multi-Stream Features Using Deep Neural Network in Speech Recognition

Combining Speech Enhancement with Feature Post-processing for Robust Speech Recognition

Time–Frequency Cepstral Features and Heteroscedastic Linear Discriminant Analysis for Language Recognition

A Multi Level Data Fusion Approach for Speaker Identification on Telephone Speech

Combination of Multiple Embeddings for Speaker Retrieval

A Fusion Approach to Spoken Language Identification Based on Combining Multiple Phone Recognizers and Speech Attribute Detectors

Time-Frequency Cepstral Features and Combining Discriminative Training for Phonotactic Language Recognition

Fusion of deep shallow features and models for speaker recognition

System Combination for Short Utterance Speaker Recognition.

A Feature Integration Network for Multi-Channel Speech Enhancement

Combination of Pitch Synchronous Analysis and Fisher Criterion for Speaker Identification

Multi-Feature Learning with Canonical Correlation Analysis Constraint for Text-Independent Speaker Verification