Application-Oriented Robustness Issues

Thomas Fang Zheng,Lantian Li

DOI: https://doi.org/10.1007/978-981-10-3238-7_4

2017-01-01

Abstract:With the development of speaker recognition technologies, they have been used in wide application areas. The main applications of speaker recognition technologies include the followings.

What problem does this paper attempt to address?

An Overview of Robustness Related Issues in Speaker Recognition

Thomas Fang Zheng,Qin Jin,Lantian Li,Jun Wang,Fanhu Bie

DOI: https://doi.org/10.1109/apsipa.2014.7041826

2014-01-01

Abstract:Speaker recognition technologies have been improved rapidly in recent years. However, critical robustness issues need to be addressed when they are applied in practical situations. This paper provides an overview of technologies dealing with robustness related issues in automatic speaker recognition. We first categorize the robustness issues into three categories, including environment-related, speaker-related and application-oriented issues. For each category, we then describe the current hot topics, existing technologies, and potential research focuses in the future.
Robustness-Related Issues in Speaker Recognition

Thomas Fang Zheng,Lantian Li

DOI: https://doi.org/10.1007/978-981-10-3238-7

2017-01-01

Abstract:This book presents an overview of speaker recognition technologies with an emphasis on dealing with robustness issues. Firstly, the book gives an overview of speaker recognition, such as the basic system framework, categories under different criteria, performance evaluation and its development history. Secondly, with regard to robustness issues, the book presents three categories, including environment-related issues, speaker-related issues and application-oriented issues. For each category, the book describes the current hot topics, existing technologies, and potential research focuses in the future. The book is a useful reference book and self-learning guide for early researchers working in the field of robust speech recognition.
Environment-Related Robustness Issues

Thomas Fang Zheng,Lantian Li

DOI: https://doi.org/10.1007/978-981-10-3238-7_2

2017-01-01

Abstract:In practical applications, many environment-related factors may influence the performance of speaker recognition. There is often no prior knowledge of these factors in advance, which makes the environment-related robustness issue more difficulty. In this chapter, three environment-related factors, background noise, cross channel and multiple-speaker, are summarized and their corresponding robustness issues are discussed.
Research and Prospect on Robustness Technology in Real-environment Speech Recognition

Liu Jingwei,Xiao Xi

DOI: https://doi.org/10.3321/j.issn:1002-8331.2006.24.003

2006-01-01

Abstract:The robustness of speech recognition system in real environment is the key problem in the application of speech recognition technique.The kernel problem is how to overcome the mismatching of acoustic feature and model between real and clean environments,which involves the important techniques on noise environment compensation,channel adaptation and speaker adaptation etc.This paper reviews the main methods,principles and ad-hoc research techniques of robust researches,analyzes the adaptation techniques of acoustic model and language model in real environment,and proposes the recent prospect of research interests in real-world environment speech recognition.
Overview of Front-end Features for Robust Speaker Recognition

Qin Jin,Thomas Fang Zheng

2011-01-01

Abstract:This paper provides an overview of automatic speaker recognition technologies, with an emphasis on front-end features for robust speaker recognition. We categorize the frontend features into low-level features and high-level features. We discussed in detail several selected low-level and high-level features including their motivations, mechanism, reported improvements, and limitations, etc. The goal of this paper is to help beginners in speaker recognition research area to catch the overall picture of current front-end features quickly.
Cost-Sensitive Learning for Emotion Robust Speaker Recognition

Dongdong Li,Yingchun Yang,Weihui Dai

DOI: https://doi.org/10.1155/2014/628516

2014-01-01

Abstract:In the field of information security, voice is one of the most important parts in biometrics. Especially, with the development of voice communication through the Internet or telephone system, huge voice data resources are accessed. In speaker recognition, voiceprint can be applied as the unique password for the user to prove his/her identity. However, speech with various emotions can cause an unacceptably high error rate and aggravate the performance of speaker recognition system. This paper deals with this problem by introducing a cost-sensitive learning technology to reweight the probability of test affective utterances in the pitch envelop level, which can enhance the robustness in emotion-dependent speaker recognition effectively. Based on that technology, a new architecture of recognition system as well as its components is proposed in this paper. The experiment conducted on the Mandarin Affective Speech Corpus shows that an improvement of 8% identification rate over the traditional speaker recognition is achieved.
ROBUSTNESS OF SPEECH RECOGNITION AND CONSTRUCTION OF A SPEECH CORPUS

Ditang Fang

1994-01-01

Abstract:A great advance for speech recognition has been obtained in the last ten years, and some systems is put into actual use and preliminarily turned into commodities today.It is the present major problem that those systems don't possess enoug hrobustness yet, thus one of the following main tasks for designing speech recognitions is to improve their robustress. For this purpose, we have constructed a Chinese speech corpus to fit the experiment on robustness of speech recognition. The construction, character, and result of above speech corpus are given in this paper.
Speaker Recognition System in Multi-Channel Environment

LF Sang,ZH Wu,YC Yang

DOI: https://doi.org/10.1109/icsmc.2003.1244369

2003-01-01

Abstract:Expansions of mobile services and private data have required increased level of protection. Speaker recognition, one of the biometric technologies, arises lots of research interests for its simple, cheap and convenient characteristics. In this paper, a robust speaker recognition system which facilitates reliable authentication with multi-channel voices is presented. A large multi-channel corpus, including mobile phone, personal digital assistant (PDA), telephone and microphone, is collected to evaluate the system performance.
State-of-the-art in speaker recognition

Marcos Faundez-Zanuy,Enric Monte-Moreno

DOI: https://doi.org/10.1109/MAES.2005.1432568

2022-02-23

Abstract:Recent advances in speech technologies have produced new tools that can be used to improve the performance and flexibility of speaker recognition While there are few degrees of freedom or alternative methods when using fingerprint or iris identification techniques, speech offers much more flexibility and different levels for performing recognition: the system can force the user to speak in a particular manner, different for each attempt to enter. Also with voice input the system has other degrees of freedom, such as the use of knowledge/codes that only the user knows, or dialectical/semantical traits that are difficult to forge. This paper offers and overview of the state of the art in speaker recognition, with special emphasis on the pros and contras, and the current research lines. The current research lines include improved classification systems, and the use of high level information by means of probabilistic grammars. In conclusion, speaker recognition is far away from being a technology where all the possibilities have already been explored.

Audio and Speech Processing,Machine Learning,Sound
Robust Speaker Recognition in Cross-Channel Condition

Yuxiang Shan,Jia Liu

DOI: https://doi.org/10.1109/cisp.2009.5303844

2009-01-01

Abstract:One of the most difficult challenges for speaker recognition is dealing with channel variability. In this paper, several new techniques of cross-channel compensation of speech signal are used for text-independent speaker verification system. These new techniques include wideband noise reduction, echo cancellation, a simplified feature-domain latent factor analysis and data-driven score normalization. The performance of different techniques across varying channel train/test conditions are presented and discussed, finding that speech enhancement, which used to be neglected for telephone speech, is essential for cross-channel tasks, and the channel compensation techniques developed for telephone channel speech also perform effectively. The per microphone performance analysis further shows that speech enhancement can boost the effects of other techniques greatly, especially on channels with larger signal-to-noise ratio (SNR) variance. All results are presented on NIST SRE 2006 and 2008 data, showing a promising performance gain compared to the baseline system.
Wavoice: A mmWave-assisted Noise-resistant Speech Recognition SystemJust Accepted

Tiantian Liu,Chao Wang,Zhengxiong Li,Ming-Chun Huang,Wenyao Xu,Feng Lin

DOI: https://doi.org/10.1145/3597457

2022-01-01

ACM Transactions on Sensor Networks

Abstract:As automatic speech recognition evolves, the deployment of voice user interface has boomingly expanded. Especially since the COVID-19 pandemic, VUI has gained more attention in online communication owing to its non-contact property. However, VUI struggles to be applied in public scenes due to the degradation of received audio signals caused by various ambient noises. In this paper, we propose Wavoice , the first noise-resistant multi-modal speech recognition system that fuses two distinct voice sensing modalities, i.e., millimeter-wave (mmWave) signals and audio signals from a microphone, together. One key contribution is to model the inherent correlation between mmWave and audio signals. Based on it, Wavoice facilitates the real-time noise-resistant voice activity detection and user targeting from multiple speakers. Additionally, we elaborate on two novel modules for multi-modal fusion embedded into the neural network, leading to accurate speech recognition. Extensive experiments prove the effectiveness of Wavoice under adverse conditions, that is, the character recognition error rate below 1 \(\% \) in a range of 7 meters. In terms of robustness and accuracy, Wavoice considerably outperforms existing audio-only speech recognition methods with lower character error rate and word error rate.
Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System

Tiantian Liu,Chao Wang,Zhengxiong Li,Ming-Chun Huang,Wenyao Xu,Feng Lin

DOI: https://doi.org/10.1145/3597457

2024-01-01

ACM Transactions on Sensor Networks

Abstract:As automatic speech recognition evolves, deployment of the voice user interface (VUI) has boomingly expanded. Especially since the COVID-19 pandemic, the VUI has gained more attention in online communication owing to its non-contact property. However, the VUI struggles to be applied in public scenes due to the degradation of received audio signals caused by various ambient noises. In this article, we propose Wavoice , the first noise-resistant multi-modal speech recognition system that fuses two distinct voices sensing modalities (i.e., millimeter-wave signals and audio signals from a microphone) together. One key contribution is to model the inherent correlation between millimeter-wave and audio signals. Based on it, Wavoice facilitates the real-time noise-resistant voice activity detection and user targeting from multiple speakers. Additionally, we elaborate on two novel modules for multi-modal fusion embedded into the neural network, leading to accurate speech recognition. Extensive experiments prove the effectiveness of Wavoice under adverse conditions—that is, the character recognition error rate below 1% in a range of 7 m. In terms of robustness and accuracy, Wavoice considerably outperforms existing audio-only speech recognition methods with lower character error and word error rates.
An Application-Oriented Taxonomy on Spoofing, Disguise and Countermeasures in Speaker Recognition

Lantian Li,Xingliang Cheng,Thomas Fang Zheng

DOI: https://doi.org/10.1561/116.00000017

2022-01-01

APSIPA Transactions on Signal and Information Processing

Abstract:Speaker recognition aims to recognize the identity of the speaking person. After decades of research, current speaker recognition systems have achieved rather satisfactory performance, and have been deployed in a wide range of practical applications. However, a massive amount of evidence shows that these systems are susceptible to malicious fake actions in real applications. To address this issue, the research community has been responding with dedicated countermeasures which aim to defend against fake actions. Recently, there are several reviews and surveys reported in the literature that describe the current state-of-the-art research advancements. Even so, these reviews and surveys are generally based on a canonical taxonomy to categorize spoofing attacks and corresponding countermeasures from the technology-oriented perspective. This paper provides a new taxonomy from the application-oriented perspective and extends to two major fake forms: spoofing attack and disguise cheating. This taxonomy starts from the applications of speaker recognition technology, e.g., access control, surveillance and forensic, and then rezones two fake forms according to different application scenarios: one is spoofing attack that imitates the voice of an authorized speaker to get access to the target system; the other one is disguise cheating that makes someone unrecognizable by altering his/her voice. Furthermore, for each fake form, more delicate categories and related countermeasures are presented. Finally, this paper discusses future research directions in this area and suggests that the research community should not only focus on the technical view but also connect with application scenarios.
Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System.

Tiantian Liu,Chao Wang,Zhengxiong Li,Ming-Chun Huang,Wenyao Xu,Feng Lin

DOI: https://doi.org/10.1145/3597457

2024-01-01

ACM Transactions on Sensor Networks

Abstract:As automatic speech recognition evolves, deployment of the voice user interface (VUI) has boomingly expanded. Especially since the COVID-19 pandemic, the VUI has gained more attention in online communication owing to its non-contact property. However, the VUI struggles to be applied in public scenes due to the degradation of received audio signals caused by various ambient noises. In this article, we propose Wavoice, the first noise-resistant multi-modal speech recognition system that fuses two distinct voices sensing modalities (i.e., millimeter-wave signals and audio signals from a microphone) together. One key contribution is to model the inherent correlation between millimeter-wave and audio signals. Based on it, Wavoice facilitates the real-time noise-resistant voice activity detection and user targeting from multiple speakers. Additionally, we elaborate on two novel modules for multi-modal fusion embedded into the neural network, leading to accurate speech recognition. Extensive experiments prove the effectiveness of Wavoice under adverse conditions-that is, the character recognition error rate below 1% in a range of 7 m. In terms of robustness and accuracy, Wavoice considerably outperforms existing audio-only speech recognition methods with lower character error and word error rates.
Robust Analysis And Interpretation Of Spoken Chinese Queries

Ruzhan Lu,Weilin Wu,Feng Gao,Yuquan Chen

DOI: https://doi.org/10.1007/1-4020-4043-1_15

2006-01-01

Abstract:In spoken dialogue systems, a robust treatment is required for the input utterance due to the recognition errors and a large set of spontaneous speech phenomena. This paper describes a framework for robust analysis and interpretation of spoken language. This framework includes inherently robust mechanisms, i.e., robust semantic parsing and robust interpretation, and an additional component as well, i.e., recognition error correction. A preliminary evaluation demonstrates that a good robustness is achieved efficiently under this framework.
An Overview of Speech Recognition Technology

Xinman Zhang,Yurui Peng,Xuebin Xu

DOI: https://doi.org/10.1109/crc.2019.00025

2019-01-01

Abstract:With the speech recognition research intensifying gradually in recent years, it is particularly important to grasp the research direction of this filed. This paper summarizes the theoretical algorithms in the development of speech recognition. Firstly, we introduce the specific process of speech recognition, including biometrics acquisition, preprocessing, feature extraction, biometrics pattern matching and recognition results. Besides, we emphatically introduce feature extraction and matching recognition algorithm. We also introduce the application platform, and give the specific application scenarios. Finally, we put forward the shortcomings of the research and prospect the future development trend.
Speech Recognition and Its Application Research Based on SPCE061A

Gao Hongliang,Liu Jinhua

2007-01-01

Abstract:Based on analyzing speech recognition principle,Sunplus's 16 bits MCU-SPCE061A is introduced in this paper,for this kind of MCU has sufficient function in voice processing,a speech recognition system based on special person is introduced,including the hardware architecture and software realization,this application can be used in kinds of areas in speech recognition,and has broad application value.
A Selection Method of Speech Vocabulary for Human-Robot Speech Interaction

Hong Liu,Xiaofei Li

DOI: https://doi.org/10.1109/icsmc.2010.5641975

2010-01-01

Abstract:Speech is the most natural and efficient way for Human-Robot Interaction (HRI), although speech recognition systems face some challenges on a mobile robot platform due to the wide range of users and varied noisy environments. This paper proposes a selection method of speech vocabulary for HRI, which can choose the most robust sub-vocabulary from the predefined isolated word vocabulary. We define a new concept, called Word Robustness, to represent the robustness of a word to speaker-independent and noise. The algorithm for computing Word Robustness is given based on Hidden Markov Model (HMM), then the most robust sub-vocabulary can be selected based on it. For convenience, this method makes use of selecting vocabulary to avoid other procedures such as speaker-adaption. Experiments were achieved based on an isolated word recognition system using a speech database which includes more than ten thousands of speech signals recorded in quiet laboratory and noisy environment respectively. Several sub-sets of vocabulary were selected for robot control based on Word Robustness. The best speaker-independent word recognition rate is 95.19% in noisy environments. Experimental results demonstrate the effectiveness of Word Robustness and the selection method.
Robust Recogmtion Method of Speech Under Stress

韩纪庆,张磊,王承发

DOI: https://doi.org/10.3969/j.issn.1002-137X.2000.09.013

2000-01-01

Computer Science

Abstract:Abstract There are many stressful envronments which deteriorate the performance of speech recognition systems. Techniques for compensating the influence of stress can help neutralize stressed speech and improve robustness of speech recognition systems. In this paper,we smmarize the aproaches for robust recognition of speech under stress and also give the advances in the area.
Research on Embedded Text-Dependent Speaker Recognition Algorithms and Its Implementation

GUO Haoting,ZHENG Fang,LUO Canhua,LI Yinguo

DOI: https://doi.org/10.3969/j.issn.1003-0077.2010.06.010

2010-01-01

Abstract:The speaker recognition technology is an important and popular user authentication method in daily life due to its convenience,economy,and easy-to-acceptance.However the current algorithms cannot meet the real-time requirements in embedded applications.Based on the Non-Linear Partition(NLP) algorithms used in speech recognition,a novel algorithm is proposed and applied to the embedded Text-Dependent Speaker Recognition.Compared with the traditional Dynamic Time Warping(DTW) based algorithms,it achieves a good practical result in terms of real time performance.

Application-Oriented Robustness Issues

An Overview of Robustness Related Issues in Speaker Recognition

Robustness-Related Issues in Speaker Recognition

Environment-Related Robustness Issues

Research and Prospect on Robustness Technology in Real-environment Speech Recognition

Overview of Front-end Features for Robust Speaker Recognition

Cost-Sensitive Learning for Emotion Robust Speaker Recognition

ROBUSTNESS OF SPEECH RECOGNITION AND CONSTRUCTION OF A SPEECH CORPUS

Speaker Recognition System in Multi-Channel Environment

State-of-the-art in speaker recognition

Robust Speaker Recognition in Cross-Channel Condition

Wavoice: A mmWave-assisted Noise-resistant Speech Recognition SystemJust Accepted

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System

An Application-Oriented Taxonomy on Spoofing, Disguise and Countermeasures in Speaker Recognition

Wavoice: an Mmwave-Assisted Noise-Resistant Speech Recognition System.

Robust Analysis And Interpretation Of Spoken Chinese Queries

An Overview of Speech Recognition Technology

Speech Recognition and Its Application Research Based on SPCE061A

A Selection Method of Speech Vocabulary for Human-Robot Speech Interaction

Robust Recogmtion Method of Speech Under Stress

Research on Embedded Text-Dependent Speaker Recognition Algorithms and Its Implementation