Abstract:Unmanned aerial vehicles (UAVs) are widely applied for purposes of inspection, search, and rescue operations by the virtue of low-cost, large-coverage, real-time, and high-resolution data acquisition capacities. Massive volumes of aerial videos are produced in these processes, in which normal events often account for an overwhelming proportion. It is extremely difficult to localize and extract abnormal events containing potentially valuable information from long video streams manually. Therefore, we are dedicated to developing anomaly detection methods to solve this issue. In this paper, we create a new dataset, named DroneAnomaly, for anomaly detection in aerial videos. This dataset provides 37 training video sequences and 22 testing video sequences from 7 different realistic scenes with various anomalous events. There are 87,488 color video frames (51,635 for training and 35,853 for testing) with the size of $640 \times 640$ at 30 frames per second. Based on this dataset, we evaluate existing methods and offer a benchmark for this task. Furthermore, we present a new baseline model, ANomaly Detection with Transformers (ANDT), which treats consecutive video frames as a sequence of tubelets, utilizes a Transformer encoder to learn feature representations from the sequence, and leverages a decoder to predict the next frame. Our network models normality in the training phase and identifies an event with unpredictable temporal dynamics as an anomaly in the test phase. Moreover, To comprehensively evaluate the performance of our proposed method, we use not only our Drone-Anomaly dataset but also another dataset. We will make our dataset and code publicly available. A demo video is available at <a class="link-external link-https" href="https://youtu.be/ancczYryOBY" rel="external noopener nofollow">this https URL</a>. We make our dataset and code publicly available .

UAV Fault and Anomaly Detection Using Autoencoders

Auto-AD: Autonomous Hyperspectral Anomaly Detection Network Based on Fully Convolutional Autoencoder

Unsupervised Anomaly Detection in Flight Data Using Convolutional Variational Auto-Encoder

On-board Deep-learning-based Unmanned Aerial Vehicle Fault Cause Detection and Identification

UAV-AdNet: Unsupervised Anomaly Detection using Deep Neural Networks for Aerial Surveillance

Automatic Real-time Anomaly Detection for Autonomous Aerial Vehicles

An Anomaly Detection Method for UAV Based on Wavelet Decomposition and Stacked Denoising Autoencoder

Anomaly Detection for Agricultural Vehicles Using Autoencoders

Vibration data-driven anomaly detection in UAVs: A deep learning approach

Context-Dependent Anomaly Detection for Low Altitude Traffic Surveillance

An Intelligent Fault Diagnosis Approach for Multirotor UAVs Based on Deep Neural Network of Multi-Resolution Transform Features

Unsupervised Abnormality Detection Using Heterogeneous Autonomous Systems

Data-driven multivariate regression-based anomaly detection and recovery of unmanned aerial vehicle flight data

Comprehensive fault diagnosis in UAV-assisted sensor networks: A three-phase automated approach

VESC: a new variational autoencoder based model for anomaly detection

Aero-Engine Fault Detection with an LSTM Auto-Encoder Combined with a Self-Attention Mechanism

A-VAE: Attention based Variational Autoencoder for Traffic Video Anomaly Detection

Effective Intrusion Detection for UAV Communications using Autoencoder-based Feature Extraction and Machine Learning Approach

DAE : Discriminatory Auto-Encoder for multivariate time-series anomaly detection in air transportation

A survey of unmanned aerial vehicle flight data anomaly detection: Technologies, applications, and future directions

Anomaly Detection in Aerial Videos with Transformers