Abstract:Extracting speech information from vibration response signals is a typical system identification problem, and the traditional method is too sensitive to deviations such as model parameters, noise, boundary conditions, and position. A method was proposed to obtain speech signals by collecting vibration signals of vibroacoustic systems for deep learning training in the work. The vibroacoustic coupling finite element model was first established with the voice signal as the excitation source. The vibration acceleration signals of the vibration response point were used as the training set to extract its spectral characteristics. Training was performed by two types of networks: fully connected, and convolutional. And it is found that the Fully Connected network prediction model has faster Rate of convergence and better quality of extracted speech. The amplitude spectra of the output speech signals (network output) and the phase of the vibration signals were used to convert extracted speech signals back to the time domain during the test set. The simulation results showed that the positions of the vibration response points had little effect on the quality of speech recognition, and good speech extraction quality can be obtained. The noises of the speech signals posed a greater influence on the speech extraction quality than the noises of the vibration signals. Extracted speech quality was poor when both had large noises. This method was robust to the position deviation of vibration responses during training and testing. The smaller the structural flexibility, the better the speech extraction quality. The quality of speech extraction was reduced in a trained system as the mass of node increased in the test set, but with negligible differences. Changes in boundary conditions did not significantly affect extracted speech quality. The speech extraction model proposed in the work has good robustness to position deviations, quality deviations, and boundary conditions.

Design and Implement of Robust Feature Extraction Algorithm

Design and implementation of a speaker recognition system

Noise Estimation Using Mean Square Cross Prediction Error for Speech Enhancement

Robust Speech Recognition by Selecting Mel-Filter Banks

Design and implementation of speech recognition algorithm based on frequency range

Modified MFCCs for Robust Speaker Recognition

Robust Speech And Non-Speech Detection

Statistical Thresholding for Robust ASR

Research of Characteristic Parameters Extraction Based on Embedded Speech Recognition System

Robust Speech Recognition Method Based on Discriminative Environment Feature Extraction

A Noise Robust Front End Algorithm for Mandarin Speech Recognition and Performance Analysis

Wavoice: A mmWave-assisted Noise-resistant Speech Recognition SystemJust Accepted

An Auditory Feature Extraction Method Based on Forward-Masking and Its Application in Robust Speaker Identification and Speech Recognition.

Robust Front-End for Speech Recognition Based on Computational Auditory Scene Analysis and Speaker Model

Compensation of Speech Enhancement Distortion for Robust Speech Recognition

Speech extraction from vibration signals based on deep learning

Auditory model-based speech feature extraction and its application to speaker identification

A Robust Speech Feature - Perceptive Scalogram Based on Wavelet Analysis

Speech Enhancement Approach Based on Minimum Estimate and Spectral Subtraction

High Performance Digit Mandarin Speech Recognition

Noise-robustness of speaker verification based on the perceptual log area ratio