Abstract:<div><h2>Abstract</h2><p>This study aims to integrate diverse data within narrative multimedia (i.e., artworks containing stories and distributed through multimedia) into a unified character network (i.e., a social network between characters that appear in the story). By combining multiple data sources (e.g., the text, video, and audio), we attempted to enhance the accuracy and semantic richness of existing character networks that confine themselves to a particular data source. To merge various data, we propose story synchronization for (i) improving the accuracy of data extracted from the narrative multimedia and (ii) integrating the data into the unified character network. The story synchronization mainly consists of three steps: synchronizing (i) scenes, (ii) characters, and (iii) character networks. First, we synchronize dialogues in the text and audio, to discover speakers and time of dialogues. This enables us to segment the scene using time periods when dialogues (in the text and audio) and characters (in the video) do not commonly occur. Through the scene segmentation, we can discretize stories in the narrative work. By comparing the occurrence of dialogues and characters in each scene, we synchronize identities of the characters in the text and video (e.g., names and faces of characters). Thereby, we can more accurately estimate participants and time of a conversation between characters (i.e., a set of connected dialogues). Based on the conversation, the existing character networks are refined and integrated into the unified character network. In addition, we verified the efficacy of the proposed methods using movies in the real world, which are among the most accessible and popular narrative multimedia.</p></div>

Learning Similarity between Movie Characters and Its Potential Implications on Understanding Human Experiences

Few-Shot Character Understanding in Movies as an Assessment to Meta-Learning of Theory-of-Mind

Character-based movie summarization.

Movies2Scenes: Using Movie Metadata to Learn Scene Representation

Learning Interactions and Relationships Between Movie Characters

Bridging the Semantic Latent Space Between Brain and Machine: Similarity is All You Need

Feature extraction using Latent Dirichlet Allocation and Neural Networks: A case study on movie synopses

A Graph-Based Framework to Bridge Movies and Synopses

"Let Your Characters Tell Their Story": A Dataset for Character-Centric Narrative Understanding

A New Method for Identifying the Relationship of Characters in the Video

Learning Video Context as Interleaved Multimodal Sequences

Multi-view Story Characterization from Movie Plot Synopses and Reviews

Integrating character networks for extracting narratives from multimodal data

MBTI Personality Prediction for Fictional Characters Using Movie Scripts

A Hierarchical Framework For Movie Content Analysis: Let Computers Watch Films Like Humans

From Trailers to Storylines: An Efficient Way to Learn from Movies

Character-Oriented Video Summarization with Visual and Textual Cues

Modeling Empathic Similarity in Personal Narratives

Comparison of novel character relationship network mining and drama character relationship shaping algorithms

Enhanced movie content similarity based on textual, auditory and visual information

Intersubjectivity and Sentiment: from Language to Knowledge