Abstract:In recent years, several Japanese companies have attempted to improve the efficiency of their meetings, which has been a significant challenge. For instance, voice recognition technology is used to considerably improve meeting minutes creation. In an automatic minutes-creating system, identifying the speaker to add speaker information to the text would substantially improve the overall efficiency of the process. Therefore, a few companies and research groups have proposed speaker estimation methods; however, it includes challenges, such as requiring advance preparation, special equipment, and multiple microphones. These problems can be solved by using speech sections that are extracted from lip movements and voice information. When a person speaks, voice and lip movements occur simultaneously. Therefore, the speaker’s speech section can be extracted from videos by using lip movement and voice information. However, when this speech section contains only voice information, the voiceprint information of each meeting participant is required for speaker identification. When using lip movements, the speech section and speaker position can be extracted without the voiceprint information. Therefore, in this study, we propose a speech-section extraction method that uses image and voice information in Japanese for speaker identification. The proposed method consists of three processes: i) the extraction of speech frames using lip movements, ii) the extraction of speech frames using voices, and iii) the classification of speech sections using these extraction results. We used video data to evaluate the functionality of the method. Further, the proposed method was compared with state-of-the-art techniques. The average F-measure of the proposed method is determined to be higher than that of the conventional methods that are based on state-of-the-art techniques. The evaluation results showed that the proposed method achieves state-of-the-art performance using a simpler process compared to the conventional method.

Study of Intra-Speakers Speech Variability Over Long and Short Time Periods for Speech Recognition

Study on Inter and Intra Speaker Variability in Speaker Recognition

TRSD: A Time-Varying and Region-Changed Speech Database for Speaker Recognition

Speaker-Independent English Consonant and Japanese Word Recognition by a Stochastic Dynamic Time Warping Method

Fuzzy Cluster Analysis and its Evaluation Method

Improving Speaker Verification Performance Against Long-Term Speaker Variability

Intrinsic Variation Robust Speaker Verification Based on Sparse Representation.

Model Session Variability in Speaker Verification

JTubeSpeech: corpus of Japanese speech collected from YouTube for speech recognition and speaker verification

Evaluation of EMD-based speaker recognition using ISCSLP2006 chinese speaker recognition evaluation corpus

A Corpus-Based Analysis Of Age-Related Changes In The Acoustic Features Of Elderly To Super Elderly Speech

Exploring the performance of automatic speaker recognition using twin speech and deep learning-based artificial neural networks

Intra-conversation intra-speaker variability compensation for speaker clustering

Construction of a Large-scale Japanese ASR Corpus on TV Recordings

An Analysis of Personalized Speech Recognition System Development for the Deaf and Hard-of-Hearing

Speech-Section Extraction Using Lip Movement and Voice Information in Japanese

STUDIES: Corpus of Japanese Empathetic Dialogue Speech Towards Friendly Voice Agent

JSUT and JVS: Free Japanese voice corpora for accelerating speech synthesis research

Exploration of Local Variability in Text-Independent Speaker Verification

Simultaneous Speech Recognition and Speaker Diarization for Monaural Dialogue Recordings with Target-Speaker Acoustic Models