Abstract:Assessing the intelligibility of dysarthric speech, characterized by intricate speaking rhythms presents formidable challenges. Current techniques for objectively testing speech intelligibility are burdensome and subjective, particularly struggling with dysarthric spoken utterances. To tackle these hurdles, our method conducts an ablation analysis across speakers afflicted with speech impairment. We utilize a unified approach that incorporates both auditory and visual elements to improve the classification of dysarthric spoken utterances. In our quest to enhance spoken utterance recognition, we propose employing two distinctive extractive transformer-based approaches. Initially, we employ SepFormer to refine the speech signal, prioritizing the enhancement of signal clarity. Subsequently, we feed the improved audio samples into Swin transformer after converting them into log mel spectrograms. Additionally, we harness the power of the Swin transformer for visual classification, trained on a dataset of 14 million annotated images from ImageNet. The pre-trained scores from the Swin transformer are utilized as input for the deep bidirectional long short-term memory with gated recurrent unit (deep BiLSTM-GRU) model, facilitating the classification of spoken utterances. Our proposed deep BiLSTM-GRU model for spoken utterance classification yields impressive results on the EasyCall speech corpus, encompassing cognitive characteristics across spoken utterances ranging from 10 to 20, delivered by both healthy individuals and those with dysarthria. Notably, our results showcase an accuracy of 98.56% for 20 utterances in male speakers, 95.11% in female speakers, and 97.64% in combined male and female speakers. Across diverse scenarios, our approach consistently achieves remarkable accuracy, surpassing other contemporary methods, all without necessitating data augmentation.

Synthetic Speech Classification: IEEE Signal Processing Cup 2022 challenge

Syn-Att: Synthetic Speech Attribution via Semi-Supervised Unknown Multi-Class Ensemble of CNNs

Detection of AI Synthesized Hindi Speech

An End-to-End Multi-Module Audio Deepfake Generation System for ADD Challenge 2023

The huya multi-speaker and multi-style speech synthesis system for m2voc challenge 2020

Transformer-Based Speech Synthesizer Attribution in an Open Set Scenario

The Iflytek System for Blizzard Machine Learning Challenge 2017-ES1

Evaluating Speech Synthesis by Training Recognizers on Synthetic Speech

AI-Synthesized Voice Detection Using Neural Vocoder Artifacts

Augmenting Polish Automatic Speech Recognition System With Synthetic Data

A Scheme Discriminating Between Synthetic Speech and Normal Speech

Synthetic Speech Spoofing Detection using MFCC and SVM

DelightfulTTS: the Microsoft Speech Synthesis System for Blizzard Challenge 2021

Synthio: Augmenting Small-Scale Audio Classification Datasets with Synthetic Data

Byakto Speech: Real-time long speech synthesis with convolutional neural network: Transfer learning from English to Bangla

A deep learning approach to dysarthric utterance classification with BiLSTM-GRU, speech cue filtering, and log mel spectrograms

A multi-speaker multi-lingual voice cloning system based on vits2 for limmits 2024 challenge

End to End Bangla Speech Synthesis

LeanSpeech: the Microsoft Lightweight Speech Synthesis System for Limmits Challenge 2023

On the Problem of Text-To-Speech Model Selection for Synthetic Data Generation in Automatic Speech Recognition

The DeepZen Speech Synthesis System for Blizzard Challenge 2023