Abstract:Recently, deep neural networks (DNN) has been employed to conduct a kind of packet loss concealment (PLC) method for digital speech transmission. Due to good mapping ability of the DNN, the DNN-based PLC method usually can achieve better speech recovery than some traditional methods. However, because the phase of speech is limited between - π and π and there is no obvious spectral structure like magnitude spectrum, it is not suitable for the DNN learning. The DNN-based PLC method is usually difficult to accurately estimate the phase of the lost speech, which also limits the quality of the recovered speech. In order to solve the problem of inaccurate phase estimation on the DNN, a new PLC method based on phase unwrapping is proposed in this paper. This method is divided into two stages: training stage and test stage. In the training stage, we first employ cellular automata (CA) to unwrap the phase of speech for making its spectrum structural. Then the unwrapped phase spectrum is used as the input feature and the training target to train the DNN model. The input feature of the DNN is consisted of the unwrapped phase spectra of few frames in front of the lost speech, and the training target is the unwrapped phase spectrum of the lost speech. In the test stage, firstly, the unwrapped phase of few frames in front of the lost speech is extracted as the input features of the DNN to obtain the unwrapped phase of the lost speech. Then the unwrapped phase of the lost speech is re-wrapped into the phase of the lost speech. Finally, combining with the estimated phase spectrum and logarithmic power spectrum (LPS) of the lost speech, we can recover the lost speech by the PLC. Experimental results show that, compared with the existing DNN-based PLC method, the proposed PLC method can better recover the lost speech and improve the quality of speech, which is suitable for the PLC of digital speech transmission.

Streaming Audio Packet Loss Concealment Based on Sinusoidal Frequency Estimation in MDCT Domain

Efficient Algorithm for Packet Loss Concealment Based on Sinusoid and Transient in MDCT Domain

An Effective Hybrid Low Delay Packet Loss Concealment Algorithm for MDCT-based Audio Codec

Hybrid Low Delay Frame Loss Concealment in an MDCT Based Audio Codec

Error Concealment for Whole Frame Losses in H264

An Accurate Low Complexity Algorithm for Frequency Estimation in Mdct Domain

An Error Concealment Algorithm for Whole Frame Loss

Error Concealment Algorithm for Spatial Multiple Description Coding of Video

MDCT Sinusoidal Analysis for Audio Signals Analysis and Processing

INTERSPEECH 2022 Audio Deep Packet Loss Concealment Challenge

tPLCnet: Real-time Deep Packet Loss Concealment in the Time Domain Using a Short Temporal Context

Improved Packet Loss Concealment for PCM VoIP

Phase unwrapping based packet loss concealment using deep neural networks

Real-time audio error concealment method based on sinusoidal model

PLCMOS -- a data-driven non-intrusive metric for the evaluation of packet loss concealment algorithms

TMGAN-PLC: Audio Packet Loss Concealment using Temporal Memory Generative Adversarial Network

Real-Time Packet Loss Concealment With Mixed Generative and Predictive Model

The ICASSP 2024 Audio Deep Packet Loss Concealment Challenge

BS-PLCNet 2: Two-stage Band-split Packet Loss Concealment Network with Intra-model Knowledge Distillation

Sparse Channel Estimation for Filtered Multitone in Underwater Communications

Error Concealment for Whole Frame Loss in HEVC