Abstract:We propose a novel video visual analytics system for interactive exploration of surveillance video data. Our approach consists of providing analysts with various views of information related to moving objects in a video. To do this we first extract each object's movement path. We visualize each movement by (a) creating a single action shot image (a still image that coalesces multiple frames), (b) plotting its trajectory in a space-time cube and (c) displaying an overall timeline view of all the movements. The action shots provide a still view of the moving object while the path view presents movement properties such as speed and location. We also provide tools for spatial and temporal filtering based on regions of interest. This allows analysts to filter out large amounts of movement activities while the action shot representation summarizes the content of each movement. We incorporated this multi-part visual representation of moving objects in sViSIT, a tool to facilitate browsing through the video content by interactive querying and retrieval of data. Based on our interaction with security personnel who routinely interact with surveillance video data, we identified some of the most common tasks performed. This resulted in designing a user study to measure time-to-completion of the various tasks. These generally required searching for specific events of interest (targets) in videos. Fourteen different tasks were designed and a total of 120 min of surveillance video were recorded (indoor and outdoor locations recording movements of people and vehicles). The time-to-completion of these tasks were compared against a manual fast forward video browsing guided with movement detection. We demonstrate how our system can facilitate lengthy video exploration and significantly reduce browsing time to find events of interest. Reports from expert users identify positive aspects of our approach which we summarize in our recommendations for future video visual analytics systems.

LANDER: Visual Analysis of Activity and Uncertainty in Surveillance Video

Uncertainty Visualization for Mobile and Wearable Devices Based Activity Recognition Systems

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

Real-time Pedestrian Crossing Lights Detection Algorithm for the Visually Impaired

Pedestrian Attribute Recognition Via Spatio-temporal Relationship Learning for Visual Surveillance

Uncertainty-aware Visual Analytics for Exploring Human Behaviors from Heterogeneous Spatial Temporal Data.

Anomaly Detection By Analyzing The Pedestrian Behavior And The Dynamic Changes Of Behavior

An Empirical Study for Human Behavior Analysis

RiskWheel: Interactive Visual Analytics for Surveillance Event Detection

Interactive exploration of surveillance video through action shot summarization and trajectory visualization

Visual Analysis of Uncertainty in Trajectories.

Visual Saliency Based Natural Landmarks Detection under Unknown Environments

Enhancing Situational Awareness in Surveillance: Leveraging Data Visualization Techniques for Machine Learning-based Video Analytics Outcomes

VisionGPT: LLM-Assisted Real-Time Anomaly Detection for Safe Visual Navigation

Recognition and Co-Analysis of Pedestrian Activities in Different Parts of Road using Traffic Camera Video

VATLD: A Visual Analytics System to Assess, Understand and Improve Traffic Light Detection

Research on Risk Analysis of Pedestrian and Vehicle Flow in Community Scenes Based on Machine Vision

Detecting Anomalous Pedestrian Behavior In Video

Action Recognition with Uncertain VLAD

Interactive Visual Discovering of Movement Patterns from Sparsely Sampled Geo-tagged Social Media Data.

Automatic association of chats and video tracks for activity learning and recognition in aerial video surveillance