Abstract:Recent advances in sensor manufacture and computer vision technologies have simulated the applications of intelligent transportation systems, while a key yet under-addressed issue in these systems is the semantic summarization of large scale surveillance video. The main difficulty of large scale surveillance video summarization arises from the contradiction between the high-degree spatiotemporal redundancies and the limited storage budget. In this paper, we propose a novel approach of large scale surveillance video summarization on the basis of event detection. In the proposed approach, we firstly obtain the trajectories of vehicles and pedestrians in a tracking-by-detection manner, and then detect the abnormal events using the trajectories. Finally, we design a disjoint max-coverage algorithm to generate a summarized sequence with maximum coverage of interested events and minimum number of frames. Compared with traditional key frame-based approaches, our approach enjoys the following favorable features. First, important information can be efficiently extracted from the redundant contents since the approach is event-centric and those interested events contain almost all the important information. Second, abnormal events are successfully detected by combining the Random Forest classifier and the trajectory features. Third, the abnormal events are designed to display, and hence further reduces the compression ratio. Due to the above features, the proposed approach is suitable for different scenarios, ranges from highway to crowded crossings. Experiments on 12 surveillance sequences validate the effectiveness and efficiency of the proposed approach.

On improving behavior subtraction

Background Subtraction Based on Nonparametric Bayesian Estimation.

Complex Background Subtraction by Pursuing Dynamic Spatio-Temporal Models

Background Subtraction with Dynamic Noise Sampling and Complementary Learning

A New Approach For Extracting And Summarizing Abnormal Activities In Surveillance Videos

Video Behavior Analysis Using Topic Models and Rough Sets [applications Notes]

Adaptive Difference Modelling for Background Subtraction.

Video abstraction based on the visual attention model and online clustering

Background subtraction in real applications: Challenges, current models and future directions

Summarizing Surveillance Videos with Local-Patch-learning-based Abnormality Detection, Blob Sequence Optimization, and Type-Based Synopsis

Background Subtraction Through Multiple Life Span Modeling

Video Abstraction via Attention Model and On-Line Clustering

Practical Automatic Background Substitution for Live Video

Dynamic Background Estimation and Complementary Learning for Pixel-Wise Foreground/background Segmentation

Behavioral profiling for adaptive video summarization: From generalization to personalization

A universal sample-based background subtraction method for traffic surveillance videos

An Imbalance Compensation Framework for Background Subtraction

Background subtraction based on low-rank and structured sparse decomposition.

Event-based Large Scale Surveillance Video Summarization.

Foreground Model for Background Subtraction with Blind Updating

Hierarchical Video Summarization with Loitering Indication