Abstract:In recent years, several Japanese companies have attempted to improve the efficiency of their meetings, which has been a significant challenge. For instance, voice recognition technology is used to considerably improve meeting minutes creation. In an automatic minutes-creating system, identifying the speaker to add speaker information to the text would substantially improve the overall efficiency of the process. Therefore, a few companies and research groups have proposed speaker estimation methods; however, it includes challenges, such as requiring advance preparation, special equipment, and multiple microphones. These problems can be solved by using speech sections that are extracted from lip movements and voice information. When a person speaks, voice and lip movements occur simultaneously. Therefore, the speaker’s speech section can be extracted from videos by using lip movement and voice information. However, when this speech section contains only voice information, the voiceprint information of each meeting participant is required for speaker identification. When using lip movements, the speech section and speaker position can be extracted without the voiceprint information. Therefore, in this study, we propose a speech-section extraction method that uses image and voice information in Japanese for speaker identification. The proposed method consists of three processes: i) the extraction of speech frames using lip movements, ii) the extraction of speech frames using voices, and iii) the classification of speech sections using these extraction results. We used video data to evaluate the functionality of the method. Further, the proposed method was compared with state-of-the-art techniques. The average F-measure of the proposed method is determined to be higher than that of the conventional methods that are based on state-of-the-art techniques. The evaluation results showed that the proposed method achieves state-of-the-art performance using a simpler process compared to the conventional method.

An Extraction Technique of Place-Related Words Based on an Association Mechanism

A Place Judgment System Based on an Association Mechanism for Natural Language Interaction

Discovering personally semantic places from GPS trajectories.

Emotion Judgment Based on Relationship between Speaker and Sentential Actor

Emotional States Based 3-D Fuzzy Atmosfield for Casual Communication Between Humans and Robots

Multi-Modal Based Fuzzy Atmosfield in Human-Robot Interaction

A Coarse-to-Fine Place Recognition Approach using Attention-guided Descriptors and Overlap Estimation

Concept of Fuzzy Atmosfield for Representing Communication Atmosphere and Its Application to Humans-Robots Interaction

A Semantic Information Retrieval Technique and an Evaluation for a Narrow Display Based on an Association Mechanism

Unknown Place Name Detection Base on YamCha for Japanese Guidance QA System

Estimating human emotions using wording and sentence patterns

Pattern Matching and Discourse Processing in Information Extraction from Japanese Text

Speech-Section Extraction Using Lip Movement and Voice Information in Japanese

An efficient location extraction algorithm by leveraging web contextual information.

Emotion Estimation from Sentence Using Relation Between Japanese Slangs and Emotion Expressions.

Estimation of word emotions based on part of speech and positional information

Japanese Named Entity Recognition for Question Answering System.

Automatic Estimation of Multidimensional Ratings from a Single Sound-Symbolic Word and Word-Based Visualization of Tactile Perceptual Space

The Extraction of Spatial Relationships from Text Based on Hybrid Method

Analyzing Relationship of Words Using Biased LexRank from Geotagged Tweets

Evaluation Of Emotion Estimation Methods Based On Statistic Features Of Emotion Tagged Corpus