Abstract:This study aims to understand the effects of face mask on speech production between Mandarin Chinese and English, and on the automatic classification of mask/no mask speech and individual speakers. A cross-linguistic study on mask speech between Mandarin Chinese and English was then conducted. Continuous speech of the phonetically balanced texts in both Chinese and English versions were recorded from thirty native speakers of Mandarin Chinese (i.e., 15 males and 15 females) with and without wearing a surgical mask. The results of acoustic analyses showed that mask speech exhibited higher F0, intensity, HNR, and lower jitter and shimmer than no mask speech for Mandarin Chinese, whereas higher HNR and lower jitter and shimmer were observed for English mask speech. The results of classification analyses showed that, based on the four supervised learning algorithms (i.e., Linear Discriminant Analysis, Naïve Bayes Classifier, Random Forest, and Support Vector Machine), undesirable performances (i.e., lower than 50%) in classifying the speech with and without a face mask, and highly-variable accuracies (i.e., ranging from 40% to 89.2%) in identifying individual speakers were achieved. These findings imply that the speakers tend to conduct acoustic adjustments to improve their speech intelligibility when wearing surgical mask. However, a cross-linguistic difference in speech strategies to compensate for intelligibility was observed that Mandarin speech was produced with higher F0, intensity, and HNR, while English was produced with higher HNR. Besides, the highly-variable accuracies of speaker identification might suggest that surgical mask would impact the general performance of the accuracy of automatic speaker recognition. In general, therefore, it seems wearing a surgical mask would impact both acoustic-phonetic and automatic speaker recognition approaches to some extent, thus suggesting particular cautions in the real-case practice of forensic speaker identification.

The perception of acoustically distorted speech produced with face masks in multilingual multi-talker environments

Linguistic Processing of Unattended Speech Under a Cocktail Party Listening Scenario

The effects of face mask on speech production and its implication for forensic speaker identification-A cross-linguistic study

Cross-language differences in informational masking of speech by speech: English versus Mandarin Chinese.

The Effect of Perceived Spatial Separation on Informational Masking of Chinese Speech.

A Cross-Linguistic Study of Informational Masking: English Versus Chinese

A one-man bilingual cocktail party: linguistic and non-linguistic effects on bilinguals' speech recognition in Mandarin and English

Effect Of Number Of Masking Talkers On Speech-On-Speech Masking In Chinese

The Perception of Chinese Speech Sounds in Masking Noise and Frequency Distortion

Effect of number of masking talkers on masking of Chinese speech

Effect of Face Masks on Automatic Speech Recognition Accuracy for Mandarin

Hearing What You Can't See: Influence of Face Masks on Speech Perception and Eye Movement by Adults With Hearing Loss

Emotionally Conditioning the Target-Speech Voice Enhances Recognition of the Target Speech under “Cocktail-Party” Listening Conditions

Combined Manipulations of the Perceived Location and Spatial Extent of the Speech-Target Image Predominantly Affect Speech-on-speech Masking

Intelligibility of face-masked speech depends on speaking style: Comparing casual, clear, and emotional speech

Spatial alignment between faces and voices improves selective attention to audio-visual speech

L2 Speech Perception in Noise

The impact of face masks on face-to-face neural tracking of speech: auditory and visual obstacles

The Effect of Masker Type and Word-Position on Word Recall and Sentence Understanding

Effects of Wearing Face Masks While Using Different Speaking Styles in Noise on Speech Intelligibility During the COVID-19 Pandemic

The impact of face coverings on audio-visual contributions to communication with conversational speech