Abstract:We present a content-based retrieval method for long surveillance videos both for wide-area (Airborne) as well as near-field imagery (CCTV). Our goal is to retrieve video segments, with a focus on detecting objects moving on routes, that match user-defined events of interest. The sheer size and remote locations where surveillance videos are acquired, necessitates highly compressed representations that are also meaningful for supporting user-defined queries. To address these challenges we archive long-surveillance video through lightweight processing based on low-level local spatio-temporal extraction of motion and object features. These are then hashed into an inverted index using locality-sensitive hashing (LSH). This local approach allows for query flexibility as well as leads to significant gains in compression. Our second task is to extract partial matches to the user-created query and assembles them into full matches using Dynamic Programming (DP). DP exploits causality to assemble the indexed low level features into a video segment which matches the query route. We examine CCTV and Airborne footage, whose low contrast makes motion extraction more difficult. We generate robust motion estimates for Airborne data using a tracklets generation algorithm while we use Horn and Schunck approach to generate motion estimates for CCTV. Our approach handles long routes, low contrasts and occlusion. We derive bounds on the rate of false positives and demonstrate the effectiveness of the approach for counting, motion pattern recognition and abandoned object applications.

Motion Feature Extraction for Content-Based Video Sequence Retrieval

Motion feature extraction scheme for content-based video retrieval

Automatic Extraction Of Moving Objects In Video Sequences Based On Spatio-Temporal Information

Video retrieval using VQ-based global motion features

Extracting Representative Motion Flows for Effective Video Retrieval

A MOTION BASED VIDEO RETRIEVAL SYSTEM

Global Motion Representation of Video Shot Based on Vector Quantization Index Histogram

Retrieval of Video Clips Using Global Motion Information

Video Content Analysis Technique

Local Motion Information-Based Video Retrieval Method

Automatic Moving Object Extraction toward Content-Based Video Representation and Indexing

An Efficient Approach to Content-Based Object Retrieval in Videos.

A Human Motion Retrieval Algorithm Based on Logical Similarity

An efficient algorithm for content-based human motion retrieval

Content-Based human motion retrieval with automatic transition

Retrieval in Long Surveillance Videos using User Described Motion and Object Attributes

A Video Content Retrieval Method Based on Spatio-temporal Change Information

Global motion estimation for moving object extraction in MPEG video streams

Retrieval Method For Video Content In Different Format Based On Spatiotemporal Features

Format-Independent Motion Content Description Based on Spatiotemporal Visual Sensitivity

Compressed Domain Motion Analysis for Video Semantic Events Detection