Abstract:Echo path delay (or ref-delay) estimation is a big challenge in acoustic echo cancellation. Different devices may introduce various ref-delay in practice. Ref-delay inconsistency slows down the convergence of adaptive filters, and also degrades the performance of deep learning models due to 'unseen' ref-delays in the training set. In this paper, a multi-task network is proposed to address both ref-delay estimation and echo cancellation tasks. The proposed architecture consists of two convolutional recurrent networks (CRNNs) to estimate the echo and enhanced signals separately, as well as a fully-connected (FC) network to estimate the echo path delay. Echo signal is first predicted, and then is combined with reference signal together for delay estimation. At the end, delay compensated reference and microphone signals are used to predict the enhanced target signal. Experimental results suggest that the proposed method makes reliable delay estimation and outperforms the existing state-of-the-art solutions in inconsistent echo path delay scenarios, in terms of echo return loss enhancement (ERLE) and perceptual evaluation of speech quality (PESQ). Furthermore, a data augmentation method is studied to evaluate the model performance on different portion of synthetical data with artificially introduced ref-delay.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is **the delay inconsistency problem in acoustic echo path delay estimation (Echo Path Delay Estimation) and acoustic echo cancellation (Acoustic Echo Cancellation, AEC)**. Specifically: 1. **Challenges in Echo Path Delay Estimation**: - Different devices may introduce different echo path delays (ref - delay) in actual use, which will slow down the convergence speed of the adaptive filter, and the performance of the deep - learning model will also be affected due to the delays not seen in the training set. 2. **Limitations of Existing Methods**: - Traditional methods usually require a separate delay - estimation component to handle the delay differences brought by different devices. - Although deep - learning methods perform well in the case of consistent delays, in practical applications, the delay differences generated by different devices may lead to a mismatch between the training set and the test set, thus affecting the model performance. 3. **The Method Proposed in the Paper**: - The paper proposes a multi - task network, which can perform echo path delay estimation and echo cancellation simultaneously. - The network structure includes two convolutional recurrent neural networks (CRNNs) used to predict the echo signal and the enhanced signal respectively, and a fully - connected network (FC) for estimating the echo path delay. 4. **Objectives**: - Improve the accuracy of echo path delay estimation in different devices and under different delay conditions. - Improve the performance of echo cancellation, especially in the case of delay inconsistency. Through this method, the paper aims to improve the accuracy of echo path delay estimation and enhance the effect of echo cancellation, so as to provide more stable and reliable performance in practical applications. ### Formula Summary - **ERLE (Echo Return Loss Enhancement)**: \[ \text{ERLE (dB)} = 10 \log_{10} \left( \frac{E\{d(t)^2\}}{E\{e(t)^2\}} \right) \] where \( E\{\cdot\} \) represents the statistical expectation, \( d(t) \) is the microphone signal, and \( e(t) \) is the residual echo signal. - **SER (Signal to Echo Ratio)**: \[ \text{SER (dB)} = 10 \log_{10} \left( \frac{E\{s(t)^2\}}{E\{y(t)^2\}} \right) \] where \( s(t) \) is the near - end speech signal, and \( y(t) \) is the estimated echo signal. These formulas are used to evaluate the performance of the echo cancellation system and ensure the robustness and effectiveness of the model under different delay conditions.

Deep Multi-task Network for Delay Estimation and Echo Cancellation

A Robust and Cascaded Acoustic Echo Cancellation Based on Deep Learning

Double Branches and Stages Neural Network for Joint Acoustic Echo and Noise Suppression

Deep Neural Network Based Regression Approach for Acoustic Echo Cancellation

Residual acoustic echo suppression based on efficient multi-task convolutional neural network

Deep Echo Cancellation Algorithm Based on Time-Frequency Domain Combination

Multi-Scale Temporal Frequency Convolutional Network With Axial Attention for Speech Enhancement

End-to-End Complex-Valued Multidilated Convolutional Neural Network for Joint Acoustic Echo Cancellation and Noise Suppression

DeepVQE: Real Time Deep Voice Quality Enhancement for Joint Acoustic Echo Cancellation, Noise Suppression and Dereverberation

Nonlinear Acoustic Echo Cancellation with Deep Learning

Acoustic Echo Cancellation by Combining Adaptive Digital Filter and Recurrent Neural Network

A Deep Hierarchical Fusion Network for Fullband Acoustic Echo Cancellation

Improving Acoustic Echo Cancellation by Exploring Speech and Echo Affinity with Multi-Head Attention.

Acoustic echo cancellation based on two‐stage BLSTM

Efficient Acoustic Echo Suppression with Condition-Aware Training

End-To-End Deep Learning-based Adaptation Control for Linear Acoustic Echo Cancellation

Deep Time Delay Neural Network for Speech Enhancement with Full Data Learning

Deep Residual Echo Suppression with A Tunable Tradeoff Between Signal Distortion and Echo Suppression

An Exploration of Task-decoupling on Two-stage Neural Post Filter for Real-time Personalized Acoustic Echo Cancellation

Adaptive Echo Cancellation Combined with Delay Estimation

AEC in a NetShell: On Target and Topology Choices for FCRN Acoustic Echo Cancellation