Abstract:Target speaker extraction (TSE) has become an attractive research topic in recent years. However, TSE under the underdetermined conditions is still a challenge. In this paper, we deal with a dual-channel TSE problem under underdetermined conditions. Geometric source separation (GSS) is used to be a solution to the TSE problem, but the performance of conventional GSS methods is limited under underdetermined conditions because of the lack of a powerful source model. We propose a dual-channel TSE method with the combined capabilities of target selection based on geometric constraints, more powerful source modeling, and nonlinear postprocessing. A geometric constraint (GC) on the target direction of arrival (DOA) is applied to select the target, and two conditional variational autoencoders (CVAEs) are used to model a single speaker's speech and interference mixture speech. For postprocessing, an ideal ratio timefrequency (TF) mask estimated from the separated interference mixture speech is used to extract the target speaker's speech. Moreover, to overcome the impact of DOA estimation errors, we improve the objective function so that the target DOA information can be modified. The experimental results demonstrate that the proposed method achieves 6.24 dB and 8.37 dB improvements compared with the baseline method in terms of signal-to-distortion ratio (SDR) and source-to-interference ratio (SIR), respectively, under medium reverberation for 470 ms. Furthermore, through the analysis of experimental results, we found that the improvement method is robust against DOA estimation errors.

Robust Time Delay Estimation for Speech Signals Using Information Theory: A Comparison Study

Robust Time-Delay Estimation for Speaker Localization Using Mutual Information Among Multiple Microphone Signals

Time Delay Estimation Via Non-Mutual Information among Multiple Microphones

Experimental Investigation of Selective Localisation by Decomposition of the Time Reversal Operator and Subspace-Based Technique

Time Delay Estimation for Speech Signal Based on FOC-spectrum

Time Delay Estimation Techniques in Source Location

Adaptive Time Delay Estimation Based on Least Mean Square Sigmoid Error with the Presence of Impulsive Noises

Research on Time Delay Estimation Methods in Source Location

Time Difference of Arrival Estimation Exploiting Multichannel Spatio-Temporal Prediction

Dual-Channel Cosine Function Based Itd Estimation For Robust Speech Separation

Dual-Channel Speech Separation Using Interaural Time Difference with Generalized Gaussian Mixture Model

A Time-Weighted Method for Predicting the Intelligibility of Speech in the Presence of Interfering Sounds

Study of Generalized Phase Spectrum Time Delay Estimation Method for Source Positioning in Small Room Acoustic Environment

Robust Acoustic Localization Via Time-Delay Compensation and Interaural Matching Filter

Speaker Identification Using Time-delay Hmes.

Two-Microphones Speech Separation Using Generalized Gaussian Mixture Model

Research on Acoustic Source Localization Using Time Difference of Arrival Measurements

Robust Time Delay Estimation Based Direction Finding in L(P)-Space

The Efficiency of Ica-Based Representation Analysis: Application to Speech Feature Extraction

Endpoint detection of speech signal based on empirical mode decomposition and Teager kurtosis

Dual-Channel Target Speaker Extraction Based on Conditional Variational Autoencoder and Directional Information