Abstract:This project aims to develop a robust video surveillance system, which can segment videos into smaller clips based on the detection of activities. It uses CCTV footage, for example, to record only major events-like the appearance of a person or a thief-so that storage is optimized and digital searches are easier. It utilizes the latest techniques in object detection and tracking, including Convolutional Neural Networks (CNNs) like YOLO, SSD, and Faster R-CNN, as well as Recurrent Neural Networks (RNNs) and Long Short-Term Memory networks (LSTMs), to achieve high accuracy in detection and capture temporal dependencies. The approach incorporates adaptive background modeling through Gaussian Mixture Models (GMM) and optical flow methods like Lucas-Kanade to detect motions. Multi-scale and contextual analysis are used to improve detection across different object sizes and environments. A hybrid motion segmentation strategy combines statistical and deep learning models to manage complex movements, while optimizations for real-time processing ensure efficient computation. Tracking methods, such as Kalman Filters and Siamese networks, are employed to maintain smooth tracking even in cases of occlusion. Detection is improved on various-sized objects for multiple scenarios by multi-scale and contextual analysis. Results demonstrate high precision and recall in detecting and tracking objects, with significant improvements in processing times and accuracy due to real-time optimizations and illumination-invariant features. The impact of this research lies in its potential to transform video surveillance, reducing storage requirements and enhancing security through reliable and efficient object detection and tracking.

TSDNN: tube sorting with deep neural networks for surveillance video synopsis

DTVNet: Dynamic Time-Lapse Video Generation via Single Still Image

Scene Adaptive Online Surveillance Video Synopsis via Dynamic Tube Rearrangement Using Octree

TDS-Net: Transformer Enhanced Dual-Stream Network for Video Anomaly Detection

Tube-Link: A Flexible Cross Tube Framework for Universal Video Segmentation

Finding Action Tubes with a Sparse-to-Dense Framework

Surveillance video synopsis framework base on tube set

Deformable Tube Network for Action Detection in Videos

Object Detection from Video Tubelets with Convolutional Neural Networks

TrackNet: Simultaneous Object Detection and Tracking and Its Application in Traffic Video Analysis

Sparse Action Tube Detection

Object Detection in Videos by High Quality Object Linking

Deep Learning for Detecting Multiple Space-Time Action Tubes in Videos

Delving into Details: Synopsis-to-Detail Networks for Video Recognition.

Background subtraction for video sequence using deep neural network

Deep Learning and Hybrid Approaches for Dynamic Scene Analysis, Object Detection and Motion Tracking

DSANet: Dynamic Segment Aggregation Network for Video-Level Representation Learning

Video Anomaly Detection using Pre-Trained Deep Convolutional Neural Nets and Context Mining

MPNET: An End-to-End Deep Neural Network for Object Detection in Surveillance Video.

TEDdet: Temporal Feature Exchange and Difference Network for Online Real-Time Action Detection

Exploring Inter-feature and Inter-class Relationships with Deep Neural Networks for Video Classification