Abstract:This paper presents a waveform modeling and generation method using hierarchical recurrent neural networks (HRNN) for speech bandwidth extension (BWE). Different from conventional BWE methods that predict spectral parameters for reconstructing wideband speech waveforms, this BWE method models and predicts waveform samples directly without using vocoders. Inspired by SampleRNN, which is an unconditional neural audio generator, the HRNN model represents the distribution of each wideband or high-frequency waveform sample conditioned on the input narrowband waveform samples using a neural network composed of long short-term memory (LSTM) layers and feed-forward layers. The LSTM layers forma hierarchical structure and each layer operates at a specific temporal resolution to efficiently capture long-span dependencies between temporal sequences. Furthermore, additional conditions, such as the bottleneck features derived from narrowband speech using a deep neural network based state classifier, are employed as auxiliary input to further improve the quality of generated wideband speech. The experimental results of comparing several waveform modeling methods show that the HRNN-based method can achieve better speech quality and run-time efficiency than the dilated convolutional neural network based method and the plain sample-level recurrent neural network based method. Our proposed method also outperforms the conventional vocoder-based BWE method using LSTM-RNNs in terms of the subjective quality of the reconstructed wideband speech.

Audio Bandwidth Extension Based on Volterra Series

Vector Quantized Diffusion Model Based Speech Bandwidth Extension

Artificial Bandwidth Extension For Speech Signals Using Speech Recogniton

A Generative Adversarial Net-Based Bandwidth Extension Method for Audio Compression

A low computational complexity bandwidth extension method for mobile audio coding

Speech Bandwidth Extension Based on Codebook Mapping and GMM

Speech Bandwidth Extension Based on Restricted Boltzmann Machines

Superwideband extension for AMR-WB using conditional codebooks

A New Method For-Estimating The Bandwidth Using Two-Channel Narrowband Signals With Strong Interference

Multi-Stage Speech Bandwidth Extension with Flexible Sampling Rate Control

Bandwidth Compression for a Bivariate Gaussian Source with Shannon-Kotel’nikov Mappings

HiFi++: a Unified Framework for Bandwidth Extension and Speech Enhancement

Real-time Video Transmission Algorithm Based on Narrow and Variable Bandwidth

Waveform Modeling and Generation Using Hierarchical Recurrent Neural Networks for Speech Bandwidth Extension

Behavioral Modeling of RF Power amplifiers Using Modified Volterra Series

Speech Bandwidth Expansion Via High Fidelity Generative Adversarial Networks

Speech bandwidth extension supported by temporal information

Speech Bandwidth Extension Based on GMM and Clustering Method

Efficient bandwidth extension of musical signals using a differentiable harmonic plus noise model

Speech Bandwidth Extension Method Using Speech Recognition And Speech Synthesis

Split Table Extension: A Low Complexity LVQ Extension Scheme in Low Bitrate Audio Coding