Abstract:In this paper, we propose a wideband (WB) to super-wideband audio bandwidth extension (BWE) method based on temporal smoothing cepstral coefficients (TSCC). A temporal relationship of audio signals is included into feature extraction in the bandwidth extension frontend to make the temporal evolution of the extended spectra smoother. In the bandwidth extension scheme, a Gammatone auditory filter bank is used to decompose the audio signal, and the energy of each frequency band is long-term smoothed using minima controlled recursive averaging (MCRA) in order to suppress transient components. The resulting ‘steady-state’ spectrum is processed by frequency weighting, and the temporal smoothing cepstral coefficients are obtained by means of the power-law loudness function and cepstral normalization. The extracted temporal smoothing cepstral coefficients are fed into a Gaussian mixture model (GMM)-based Bayesian estimator to estimate the high-frequency (HF) spectral envelope, while the fine structure is restored by spectral translation. Evaluation results show that the temporal smoothing cepstral coefficients exploit the temporal relationship of audio signals and provide higher mutual information between the low- and high-frequency parameters, without increasing the dimension of input vectors in the frontend of bandwidth extension systems. In addition, the proposed bandwidth extension method is applied into the G.729.1 wideband codec and outperforms the Mel frequency cepstral coefficient (MFCC)-based method in terms of log spectral distortion (LSD), cosh measure, and differential log spectral distortion. Further, the proposed method improves the smoothness of the reconstructed spectrum over time and also gains a good performance in the subjective listening tests.

Speech Bandwidth Extension Based on GMM and Clustering Method

Speech Bandwidth Extension Based on Codebook Mapping and GMM

Speech Bandwidth Extension Based on Restricted Boltzmann Machines

Speech bandwidth extension supported by temporal information

Audio Bandwidth Extension Based on Temporal Smoothing Cepstral Coefficients

Speech Bandwidth Extension Using Recurrent Temporal Restricted Boltzmann Machines

Restoring High Frequency Spectral Envelopes Using Neural Networks For Speech Bandwidth Extension

Multi-Stage Speech Bandwidth Extension with Flexible Sampling Rate Control

Speech Bandwidth Extension Using Bottleneck Features and Deep Recurrent Neural Networks.

Using conditional restricted Boltzmann machines for spectral envelope modeling in speech bandwidth extension.

A Novel Unified Framework for Speech Enhancement and Bandwidth Extension Based on Jointly Trained Neural Networks

Compressed Domain Speech Enhancement Based on Gaussian Mixture Model

Audio Bandwidth Extension Based on Ensemble Echo State Networks with Temporal Evolution

Blind Bandwidth Extension Of Audio Signals Based On Non-Linear Prediction And Hidden Markov Model

Recurrent neural network for spectral mapping in speech bandwidth extension

Voice Conversion Using Improved Spectral and F0 Transformation Methods.

Speech Bandwidth Expansion Based on Deep Neural Networks

Duration Weighted Gaussian Mixture Model Supervector Modeling for Robust Speaker Recognition.

An Adaptive Β-Order MMSE Estimator for Speech Enhancement Using Super-Gaussian Speech Model

Speech Enhancement with Gamma Speech Modeling

Speech Enhancement Method with Geometric Phase Estimation by Incorporating MIXMAX Model.