Abstract:A two‐stage segment‐level video anomaly detection framework is proposed; specifically, in the first stage, an improved I3D network is used as a feature extractor to capture spatiotemporal features from the input video. In the second stage, a multiple instance learning method is introduced, where the averaged spatiotemporal features output by the I3D network are fed into a segment‐level anomaly classifier to construct an anomaly detection model using a deep multiple instance ranking framework. To promptly detect abnormal events in surveillance videos, this article designs a video anomaly detection method based on multiple instance learning. Generally, abnormal events occur less frequently compared to normal events. Traditional video surveillance relies on manual operation to monitor scenes and detect abnormal events by watching surveillance videos. However, watching surveillance footage is a labor‐intensive task, and prolonged observation can lead to visual fatigue and lack of concentration, which in turn results in missed detections and false positives [1]. Therefore, it is crucial to develop intelligent algorithms for video anomaly detection. The method can detect whether segments of a video contain abnormal events. First, the I3D network is used as a feature extractor to capture spatiotemporal features from the input video. Then, the spatiotemporal information is processed and input into a segment‐level anomaly detector based on multiple instance learning for detection. The authors treat abnormal videos as positive bags and normal videos as negative bags, and automatically learn a deep anomaly ranking model that can predict abnormal segments. Finally, the results of the training were tested and analyzed, demonstrating that the model is capable of detecting abnormal traffic segments.

A two-stream abnormal detection using a cascade of extreme learning machines and stacked auto encoder

DSLSTM: a deep convolutional encoder–decoder architecture for abnormality detection in video surveillance

EADN: An Efficient Deep Learning Model for Anomaly Detection in Videos

Abnormal Event Detection in Videos using Spatiotemporal AutoEncoder

A data stream-based approach for anomaly detection in surveillance videos

Two‐stage video anomaly detection based on dual‐stream networks and multi‐instance learning

Artificial Intelligence of Things-assisted two-stream neural network for anomaly detection in surveillance Big Video Data

Stack Multiple Shallow Autoencoders into a Strong One: A New Reconstruction-Based Method to Detect Anomaly

A Scalable and Generalized Deep Learning Framework for Anomaly Detection in Surveillance Videos

Residual spatiotemporal autoencoder for unsupervised video anomaly detection

Deep learning based anomaly detection in real-time video

Video anomaly detection based on a multi-layer reconstruction autoencoder with a variance attention strategy

Self-Distilled Masked Auto-Encoders are Efficient Video Anomaly Detectors

Violence detection in videos using deep recurrent and convolutional neural networks

An Efficient CNN and BI-LSTM Model for Abnormal Event Detection in Video Surveillance

Detecting Abnormal Behaviors in Surveillance Videos Based on Fuzzy Clustering and Multiple Auto-Encoders

Anomaly Detection Via Midlevel Visual Attributes

Abnormal Event Detection In Videos Using Deep Embedding

Human abnormal behavior recognition based on two-stream convolutional neural network

Anomaly Detection with ELM-Based Visual Attribute and Spatio-temporal Pyramid

Deep Appearance Features for Abnormal Behavior Detection in Video