Abstract:Recent advances in sensor manufacture and computer vision technologies have simulated the applications of intelligent transportation systems, while a key yet under-addressed issue in these systems is the semantic summarization of large scale surveillance video. The main difficulty of large scale surveillance video summarization arises from the contradiction between the high-degree spatiotemporal redundancies and the limited storage budget. In this paper, we propose a novel approach of large scale surveillance video summarization on the basis of event detection. In the proposed approach, we firstly obtain the trajectories of vehicles and pedestrians in a tracking-by-detection manner, and then detect the abnormal events using the trajectories. Finally, we design a disjoint max-coverage algorithm to generate a summarized sequence with maximum coverage of interested events and minimum number of frames. Compared with traditional key frame-based approaches, our approach enjoys the following favorable features. First, important information can be efficiently extracted from the redundant contents since the approach is event-centric and those interested events contain almost all the important information. Second, abnormal events are successfully detected by combining the Random Forest classifier and the trajectory features. Third, the abnormal events are designed to display, and hence further reduces the compression ratio. Due to the above features, the proposed approach is suitable for different scenarios, ranges from highway to crowded crossings. Experiments on 12 surveillance sequences validate the effectiveness and efficiency of the proposed approach.

A Novel Event-Oriented Segment-Of-Interest Discovery Method For Surveillance Video

Detection and Segmentation of Moving Objects Using Temporal and Spatial Cues

Experiential Sampling for Video Surveillance

Video Identification Using Spatio-temporal Salient Points

Interactive Surveillance Event Detection through Mid-level Discriminative Representation

Event-based Large Scale Surveillance Video Summarization.

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Semantic-based surveillance video retrieval

A System Based On Sequence Learning For Event Detection In Surveillance Video

Revealing Event Saliency in Unconstrained Video Collection

Experiential sampling for monitoring

An Object-Aware Anomaly Detection and Localization in Surveillance Videos.

An Automated Video Object Extraction System Based on Spatiotemporal Independent Component Analysis and Multiscale Segmentation

A Representative-Based Framework For Parsing And Summarizing Events In Surveillance Videos

Automatic Segmentation of Objects of Interest in Video: a Unified Framework

Video Data Mining: Semantic Indexing and Event Detection from the Association Perspective

EventPoint: Self-Supervised Interest Point Detection and Description for Event-based Camera

Intelligent Analysis Oriented Surveillance Video Coding.

A Method of Surveillance Video Structured Based on Gaussian Mixture Model and Support Vector Machine

Un-EvMoSeg: Unsupervised Event-based Independent Motion Segmentation

Target-Aware Object Discovery and Association for Unsupervised Video Multi-Object Segmentation