Abstract:The growing rate of public space CCTV installations has generated a need for automated methods for exploiting video surveillance data including scene understanding, query, behaviour annotation and summarization. For this reason, extensive research has been performed on surveillance scene understanding and analysis. However, most studies have considered single scenes, or groups of adjacent scenes. The semantic similarity between different but related scenes (e.g., many different traffic scenes of similar layout) is not generally exploited to improve any automated surveillance tasks and reduce manual effort. Exploiting commonality, and sharing any supervised annotations, between different scenes is however challenging due to: Some scenes are totally un-related -- and thus any information sharing between them would be detrimental; while others may only share a subset of common activities -- and thus information sharing is only useful if it is selective. Moreover, semantically similar activities which should be modelled together and shared across scenes may have quite different pixel-level appearance in each scene. To address these issues we develop a new framework for distributed multiple-scene global understanding that clusters surveillance scenes by their ability to explain each other's behaviours; and further discovers which subset of activities are shared versus scene-specific within each cluster. We show how to use this structured representation of multiple scenes to improve common surveillance tasks including scene activity understanding, cross-scene query-by-example, behaviour classification with reduced supervised labelling requirements, and video summarization. In each case we demonstrate how our multi-scene model improves on a collection of standard single scene models and a flat model of all scenes.

Latest Development of Scene Surveillance and Understanding

An Intelligent Surveillance System Base on Accelerated Human and Face Detection

A survey on scene image classification

Deep learning-based scene understanding for autonomous robots: a survey

Scene recognition: A comprehensive survey

Vision-Based Semantic Segmentation in Scene Understanding for Autonomous Driving: Recent Achievements, Challenges, and Outlooks

Advances in Deep Concealed Scene Understanding

A Survey on Deep Learning-Driven Remote Sensing Image Scene Understanding: Scene Classification, Scene Retrieval and Scene-Guided Object Detection

Scene text detection and recognition with advances in deep learning: a survey

Scene text detection and recognition: recent advances and future trends

Development and Challenges of Object Detection: A Survey

Text Recognition in the Wild: A Survey

Recent advances in 3D object detection based on RGB-D: A survey

Discovery of Shared Semantic Spaces for Multi-Scene Video Query and Summarization

Sparse Camera Network for Visual Surveillance -- A Comprehensive Survey

Study of Adaptive Background Modeling in Nonstationary Scene

Scene Text Detection in Natural Images: A Review

A Parallel Framework for Scene Understanding

Recent Advances in Scene Image Representation and Classification

Vision Technologies with Applications in Traffic Surveillance Systems: A Holistic Survey

Scene Graph Generation: A Comprehensive Survey