Abstract:With the rapid development of mobile Internet, the popularity of video capture devices has brought a surge in multimedia video resources. Utilizing machine learning methods combined with well-designed features, we could automatically obtain video summarization to relax video resource consumption and retrieval issues. However, there always exists a gap between the summarization obtained by the model and the ones annotated by users. How to help users understand the difference, provide insights in improving the model, and enhance the trust in the model remains challenging in the current study. To address these challenges, we propose VSumVis under a user-centered design methodology, a visual analysis system with multi-feature examination and multi-level exploration, which could help users explore and analyze video content, as well as the intrinsic relationship that existed in our video summarization model. The system contains multiple coordinated views, i.e., video view, projection view, detail view, and sequential frames view. A multi-level analysis process to integrate video events and frames are presented with clusters and nodes visualization in our system. Temporal patterns concerning the difference between the manual annotation score and the saliency score produced by our model are further investigated and distinguished with sequential frames view. Moreover, we propose a set of rich user interactions that enable an in-depth, multi-faceted analysis of the features in our video summarization model. We conduct case studies and interviews with domain experts to provide anecdotal evidence about the effectiveness of our approach. Quantitative feedback from a user study confirms the usefulness of our visual system for exploring the video summarization model.

Visual Analysis for Wildlife Preserve Based on Muti-systems

A Collaborative Visual Analysis System for Communication Pattern Discovery

Visual Bird Watcher: Interactive Visual Analysis on Bird Distribution and Migration

Visual Analysis for Multi-Spectral Images Comparisons

Interactive and Collaborative Visual Analysis on Traffic Sensor Data.

Visual analytics support for collecting and correlating evidence for intelligence analysis.

Unraveling Complexity: an Exploration into the Large-Scale Multi-Modal Signal Processing

A Visual Analysis Approach for Community Detection of Multi-Context Mobile Social Networks

Behavior Analysis Through Collaborative Visual Exploration on Trajectory Data.

Visual Analysis of Multivariate Time Series of Static and Mobile Sensors.

PVUW 2024 Challenge on Complex Video Understanding: Methods and Results

Temporal Pattern Analysis and Source Detection Through Visual Analysis on Multi-Dimensional Time Series Data.

A Platform for Collaborative Visual Analysis on Streaming Messages

DSTVis: toward better interactive visual analysis of Drones' spatio-temporal data

Synergistic Monitoring System Via LiDAR and Visual Sensors for Detecting Wildlife Intrusion

STAD-HD : Spatial Temporal Anomaly Detection for Heterogeneous Data through Visual Analytics

Visual Exploration of Movement Relatedness for Multi-species Ecology Analysis

VSCC'2017

VSCC'2017: Visual Analysis for Smart and Connected Communities.

VSumVis: Interactive Visual Understanding and Diagnosis of Video Summarization Model

A video integration surveillance system based on image stitching