Abstract:To address the monaural speech enhancement problem, numerous research studies have been conducted to enhance speech via operations either in time-domain on the inner-domain learned from the speech mixture or in time--frequency domain on the fixed full-band short time Fourier transform (STFT) spectrograms. Very recently, a few studies on sub-band based speech enhancement have been proposed. By enhancing speech via operations on sub-band spectrograms, those studies demonstrated competitive performances on the benchmark dataset of DNS2020. Despite attractive, this new research direction has not been fully explored and there is still room for improvement. As such, in this study, we delve into the latest research direction and propose a sub-band based speech enhancement system with perceptually-motivated optimization and dual transformations, called PT-FSE. Specially, our proposed PT-FSE model improves its backbone, a full-band and sub-band fusion model, by three efforts. First, we design a frequency transformation module that aims to strengthen the global frequency correlation. Then a temporal transformation is introduced to capture long range temporal contexts. Lastly, a novel loss, with leverage of properties of human auditory perception, is proposed to facilitate the model to focus on low frequency enhancement. To validate the effectiveness of our proposed model, extensive experiments are conducted on the DNS2020 dataset. Experimental results show that our PT-FSE system achieves substantial improvements over its backbone, but also outperforms the current state-of-the-art while being 27\% smaller than the SOTA. With average NB-PESQ of 3.57 on the benchmark dataset, our system offers the best speech enhancement results reported till date.

A novel algorithm of seeking FrFT order for speech enhancement

Forensic Speech Enhancement Based on Two-Dimensional Fractional Fourier Transform Domain

Forensic Speech Information Hiding Using Fractional Cosine-Cepstrum Transform

Quality Weight Based on Log Modulation Amplitude for Fringe Analysis During Optical Fringe Measurement

Fractional Spaced Channel Estimation and Shortening for Joint Delayed Decision Feedback Sequence Estimation.

Adaptive Harmonic Fractional Fourier Transform

A New Robust Pitch Determination Algorithm for Telephone Speech

Speech Enhancement with Perceptually-motivated Optimization and Dual Transformations

A Speech Enhancement Algorithm Based on Computational Auditory Scene Analysis

Optimized sparse fractional Fourier transform: Principle and performance analysis

Enhancement Algorithm for Low Signal to Noise Ratio Speech

Speech Enhancement Algorithm Based on Spectral Subtraction

Speech Enhancement Based On Analysis Synthesis Framework With Improved Pitch Estimation And Spectral Envelope Enhancement

Speech Enhancement Approach Based on Minimum Estimate and Spectral Subtraction

Application of optimal FrFT order for improving the azimuth resolution of range Doppler imaging algorithm

A General Unfolding Speech Enhancement Method Motivated by Taylor's Theorem

Phase Extraction from Arbitrary Phase-Shifted Fringe Patterns with Noise Suppression

Online Monaural Speech Enhancement Based on Periodicity Analysis and A Priori SNR Estimation

A Refining Underlying Information Framework for Monaural Speech Enhancement

A novel chirp based modulation and detection scheme using fractional Fourier transform

A novel speech processing algorithm for cochlear implant based on selective fundamental frequency control