Abstract:Multi-channel speech enhancement has become an active area of research, demonstrating excellent performance in recovering desired speech signals from noisy environments. Recent approaches have increasingly focused on leveraging spectral information from multi-channel inputs, yielding promising results. In this study, we propose a novel feature integration network that not only captures spectral information but also refines it through shifted-window-based self-attention, enhancing the quality and precision of the feature extraction. Our network consists of blocks containing a full- and sub-band LSTM module for capturing spectral information, and a global–local attention fusion module for refining this information. The full- and sub-band LSTM module integrates both full-band and sub-band information through two LSTM layers, while the global–local attention fusion module learns global and local attention in a dual-branch architecture. To further enhance the feature integration, we fuse the outputs of these branches using a spatial attention module. The model is trained to predict the complex ratio mask (CRM), thereby improving the quality of the enhanced signal. We conducted an ablation study to assess the contribution of each module, with each showing a significant impact on performance. Additionally, our model was trained on the SPA-DNS dataset using a circular microphone array and the Libri-wham dataset with a linear microphone array, achieving competitive results compared to state-of-the-art models.

Multi-Pitch Detection for Co-Channel Speech Utilizing Frequency Channel Piecewise Integration and Morphological Feedback Verification Tracking

Single-channel speech separation integrating pitch information based on a multi task learning framework

Simplified Deformation Compensation for Emotional Speaker Recognition

A Pitch Period Detection Algorithm Using Time and Frequency Analyses

Research on real-time detection technology of Chinese voiced speech pitch

Speech Enhancement Based On Analysis Synthesis Framework With Improved Pitch Estimation And Spectral Envelope Enhancement

A Hybrid Approach for Co-Channel Speech Segregation based on CASA, HMM Multipitch Tracking, and Medium Frame Harmonic Model

Multi-Speaker Pitch Tracking Via Embodied Self-Supervised Learning

A Multi-channel Speech Separation System for Unknown Number of Multiple Speakers

Multi-layered Features with SVM for Text-independent Speaker Verification

Multipitch estimation based on the iterative detection and separation of note events from single-channel polyphonic recordings

Robust Multipitch Estimation Of Piano Sounds Using Deep Spiking Neural Networks

Detectionoftimevaryingpitchintonallanguages: Anapproachbasedonensembleempirical Modedecomposition ∗

Detection of Time Varying Pitch in Tonal Languages: an Approach Based on Ensemble Empirical Mode Decomposition

Speech Enhancement Based on Analysis–Synthesis Framework with Improved Parameter Domain Enhancement

Distortionless Multi-Channel Target Speech Enhancement for Overlapped Speech Recognition

A Feature Integration Network for Multi-Channel Speech Enhancement

Combining Mfcc And Pitch To Enhance The Performance Of The Gender Recognition

Multi-Channel Feature Adaptation for Robust Speech Recognition

Voice Activity Detection Algorithm Based on Long-Term Pitch Information

Dual-Channel Speech Separation by Sub-Segmental Directional Statistics