Abstract:This paper presents a novel neural speech phase prediction model which predicts wrapped phase spectra directly from amplitude spectra. The proposed model is a cascade of a residual convolutional network and a parallel estimation architecture. The parallel estimation architecture is a core module for direct wrapped phase prediction. This architecture consists of two parallel linear convolutional layers and a phase calculation formula, imitating the process of calculating the phase spectra from the real and imaginary parts of complex spectra and strictly restricting the predicted phase values to the principal value interval. To avoid the error expansion issue caused by phase wrapping, we design anti-wrapping training losses defined between the predicted wrapped phase spectra and natural ones by activating the instantaneous phase error, group delay error and instantaneous angular frequency error using an anti-wrapping function. We mathematically demonstrate that the anti-wrapping function should possess three properties, namely parity, periodicity and monotonicity. We also achieve low-latency streamable phase prediction by combining causal convolutions and knowledge distillation training strategies. For both analysis-synthesis and specific speech generation tasks, experimental results show that our proposed neural speech phase prediction model outperforms the iterative phase estimation algorithms and neural network-based phase prediction methods in terms of phase prediction precision, efficiency and robustness. Compared with HiFi-GAN-based waveform reconstruction method, our proposed model also shows outstanding efficiency advantages while ensuring the quality of synthesized speech. To the best of our knowledge, we are the first to directly predict speech phase spectra from amplitude spectra only via neural networks.

Prediction in speech coding: the modification of the coding of LPC parameters and nonlinear estimation technique by using ANN

Neural Feature Predictor and Discriminative Residual Coding for Low-Bitrate Speech Coding

Subframe Interpolation Optimized Coding Of Lsf Parameters

A Robust Frame-based Nonlinear Prediction System for Automatic Speech Coding

Wide band sub-band speech coding using nonlinear prediction

Research on Low Delay Low Bit Rate Speech Coding Algorithm

Long-frame-shift Neural Speech Phase Prediction with Spectral Continuity Enhancement and Interpolation Error Compensation

LPCSE: Neural Speech Enhancement through Linear Predictive Coding

Method of Solving LPC Coefficients of Speech Signals

A Novel Digital Predistortion Coefficients Prediction Technique for Dynamic PA Nonlinearities Using Artificial Neural Networks

Studying Performance For The Gain Filters Of 8kbit/S Ld-Acelp

A Audio Coding Algorithm for Interactive Communications

A Scheme of Channel Prediction Based on Artificial Neural Network

Study on Chinese Speech Characteristics by Short-Term Nonlinear Prediction

Source-Aware Neural Speech Coding for Noisy Speech Compression

Low-Latency Neural Speech Phase Prediction based on Parallel Estimation Architecture and Anti-Wrapping Losses for Speech Generation Tasks

Neural Network-Based Arithmetic Coding for Inter Prediction Information in HEVC

Speech Prediction using an Adaptive Recurrent Neural Network with Application to Packet Loss Concealment

LSTM based AE-DNN constraint for better late reverb suppression in multi-channel LP formulation

A comparative study of several ADPCM schemes with linear and nonlinear prediction

Improving LPCNet-based Text-to-Speech with Linear Prediction-structured Mixture Density Network