Abstract:Packet loss is a common problem in data transmission, including speech data transmission. This may affect a wide range of applications that stream audio data, like streaming applications or speech emotion recognition (SER). Packet Loss Concealment (PLC) is any technique of facing packet loss. Simple PLC baselines are 0-substitution or linear interpolation. In this paper, we present a concealment wrapper, which can be used with stacked recurrent neural cells. The concealment cell can provide a recurrent neural network (ConcealNet), that performs real-time step-wise end-to-end PLC at inference time. Additionally, extending this with an end-to-end emotion prediction neural network provides a network that performs SER from audio with lost frames, end-to-end. The proposed model is compared against the fore-mentioned baselines. Additionally, a bidirectional variant with better performance is utilised. For evaluation, we chose the public RECOLA dataset given its long audio tracks with continuous emotion labels. ConcealNet is evaluated on the reconstruction of the audio and the quality of corresponding emotions predicted after that. The proposed ConcealNet model has shown considerable improvement, for both audio reconstruction and the corresponding emotion prediction, in environments that do not have losses with long duration, even when the losses occur frequently.

A Neural Vocoder Based Packet Loss Concealment Algorithm

Consecutive Packet Loss Concealment Algorithm Based on SELP Vocoder

A Packet Loss Concealment Algorithem Using Speech Recognition and Synthesis

Efficient Algorithm for Packet Loss Concealment Based on Sinusoid and Transient in MDCT Domain

On Deep Speech Packet Loss Concealment: A Mini-Survey

An Error Concealment Algorithm for Whole Frame Loss

Improved Packet Loss Concealment for PCM VoIP

A Time-Frequency Generative Adversarial based method for Audio Packet Loss Concealment

A New Error Concealment Technique for VoIP Based on Forward Contour Prediction

A side information based packet loss recovery algorithm in VoIP

Study of an improved packet loss concealment algorithm based on G.711

A CSI and Rate-Distortion Based Packet Loss Recovery Algorithm for VoIP

Streaming Audio Packet Loss Concealment Based on Sinusoidal Frequency Estimation in MDCT Domain

Real-Time Packet Loss Concealment With Mixed Generative and Predictive Model

A Speech Error Concealment Algorithm Based on Parameter Redundancy and Voiced/unvoiced Classification

Towards Error-Resilient Neural Speech Coding

A New Packet Loss Concealment Method Based on PAOLA

Improvement of Packet Loss Concealment for EVS Codec Based on Deep Learning

ConcealNet: An End-to-end Neural Network for Packet Loss Concealment in Deep Speech Emotion Recognition

Comparison and Optimization of Packet Loss Recovery Methods Based on AMR-WB for VoIP

A Deep Learning Approach for Low-Latency Packet Loss Concealment of Audio Signals in Networked Music Performance Applications