Abstract:This thesis is part of a CIFRE agreement between the company Othello and the LIASD laboratory. The objective is to develop an artificial intelligence system that can detect real-time dangers in a video stream. To achieve this, a novel approach combining temporal and spatial analysis has been proposed. Several avenues have been explored to improve anomaly detection by integrating object detection, human pose detection, and motion analysis. For result interpretability, techniques commonly used for image analysis, such as activation and saliency maps, have been extended to videos, and an original method has been proposed. The proposed architecture performs binary or multiclass classification depending on whether an alert or the cause needs to be identified. Numerous neural networkmodels have been tested, and three of them have been selected. You Only Looks Once (YOLO) has been used for spatial analysis, a Convolutional Recurrent Neuronal Network (CRNN) composed of VGG19 and a Gated Recurrent Unit (GRU) for temporal analysis, and a multi-layer perceptron for classification. These models handle different types of data and can be combined in parallel or in series. Although the parallel mode is faster, the serial mode is generally more reliable. For training these models, supervised learning was chosen, and two proprietary datasets were created. The first dataset focuses on objects that may play a potential role in anomalies, while the second consists of videos containing anomalies or non-anomalies. This approach allows for the processing of both continuous video streams and finite videos, providing greater flexibility in detection.

Real time anomalies detection on video

Real-Time Anomaly Detection in Video Streams

Hybrid Architecture for Real-Time Video Anomaly Detection: Integrating Spatial and Temporal Analysis

Deep learning based anomaly detection in real-time video

An Enhancing Timeseries Anomaly Detection Using LSTM and Bi-LSTM Architectures

Real-world Video Anomaly Detection by Extracting Salient Features in Videos

From CNN to CNN + RNN: Adapting Visualization Techniques for Time-Series Anomaly Detection

Real-time anomaly detection on surveillance video with two-stream spatio-temporal generative model

Deep Video Anomaly Detection: Opportunities and Challenges

Detecting anomalies in security cameras with 3D-convolutional neural network and convolutional long short-term memory

Video Anomaly Detection using Pre-Trained Deep Convolutional Neural Nets and Context Mining

Anomaly Detection Based on Latent Feature Training in Surveillance Scenarios

Video Anomaly Detection for Smart Surveillance

Unusual Human Behavior Detection System in Real-Time Video Systems

Deep Learning-Based Anomaly Detection in Video Surveillance: A Survey

Anomaly Recognition from surveillance videos using 3D Convolutional Neural Networks

Video Anomaly Detection Based on Deep Learning

A real time crime scene intelligent video surveillance systems in violence detection framework using deep learning techniques

CNN features with bi-directional LSTM for real-time anomaly detection in surveillance networks

Decoupled appearance and motion learning for efficient anomaly detection in surveillance video