Abstract:In e-commerce, consumer-generated videos, which in general deliver consumers' individual preferences for the different aspects of certain products, are massive in volume. To recommend these videos to potential consumers more effectively, diverse and catchy video titles are critical. However, consumer-generated videos seldom accompany appropriate titles. To bridge this gap, we integrate comprehensive sources of information, including the content of consumer-generated videos, the narrative comment sentences supplied by consumers, and the product attributes, in an end-to-end modeling framework. Although automatic video titling is very useful and demanding, it is much less addressed than video captioning. The latter focuses on generating sentences that describe videos as a whole while our task requires the product-aware multi-grained video analysis. To tackle this issue, the proposed method consists of two processes, i.e., granular-level interaction modeling and abstraction-level story-line summarization. Specifically, the granular-level interaction modeling first utilizes temporal-spatial landmark cues, descriptive words, and abstractive attributes to builds three individual graphs and recognizes the intra-actions in each graph through Graph Neural Networks (GNN). Then the global-local aggregation module is proposed to model inter-actions across graphs and aggregate heterogeneous graphs into a holistic graph representation. The abstraction-level story-line summarization further considers both frame-level video features and the holistic graph to utilize the interactions between products and backgrounds, and generate the story-line topic of the video. We collect a large-scale dataset accordingly from real-world data in Taobao, a world-leading e-commerce platform, and will make the desensitized version publicly available to nourish further development of the research community...

Automatic Generation of Interactive Nonlinear Video for Online Apparel Shopping Navigation

A Music-Driven System for Generating Apparel Display Video

Analyzing and Predicting Consumer Response to Short Videos in E-Commerce

Comprehensive Information Integration Modeling Framework for Video Titling

An Explainable XGBoost-based Approach for Assessing Product Presentation Video

Enhancing Viewing Experience of Generated Visual Storylines for Promotional Videos

VideoDiscovery: An Automatic Short-Video Generation System for E-commerce Live-streaming

Enrichment of Product Presentation Video: Methods and Impacts on User Experience

StoryNavi: On-Demand Narrative-Driven Reconstruction of Video Play With Generative AI

SmartShots: Enabling Automatic Generation of Videos with Data Visualizations Embedded

SEMI: A Sequential Multi-Modal Information Transfer Network for E-Commerce Micro-Video Recommendations

Short Video-based Advertisements Evaluation System: Self-Organizing Learning Approach

InteractiveVideo: User-Centric Controllable Video Generation with Synergistic Multimodal Instructions

Automatic Generation of Two-Level Hierarchical Tutorials from Instructional Makeup Videos

Implicit semantic-based personalized micro-videos recommendation

AnchorCrafter: Animate CyberAnchors Saling Your Products via Human-Object Interacting Video Generation

MovieDreamer: Hierarchical Generation for Coherent Long Visual Sequence

Neural Graph Matching for Video Retrieval in Large-Scale Video-driven E-commerce

Predicting Content Similarity Via Multimodal Modeling for Video-In-Video Advertising.

Make-Your-Video: Customized Video Generation Using Textual and Structural Guidance

SEINE: Short-to-Long Video Diffusion Model for Generative Transition and Prediction