Abstract:This paper proposes a space-time multi-scale attention network (STANet) to solve density map estimation, localization and tracking in dense crowds of video clips captured by drones with arbitrary crowd density, perspective, and flight altitude. Our STANet method aggregates multi-scale feature maps in sequential frames to exploit the temporal coherency, and then predict the density maps, localize the targets, and associate them in crowds simultaneously. A coarse-to-fine process is designed to gradually apply the attention module on the aggregated multi-scale feature maps to enforce the network to exploit the discriminative space-time features for better performance. The whole network is trained in an end-to-end manner with the multi-task loss, formed by three terms, i.e., the density map loss, localization loss and association loss. The non-maximal suppression followed by the min-cost flow framework is used to generate the trajectories of targets' in scenarios. Since existing crowd counting datasets merely focus on crowd counting in static cameras rather than density map estimation, counting and tracking in crowds on drones, we have collected a new large-scale drone-based dataset, DroneCrowd, formed by 112 video clips with 33,600 high resolution frames (i.e., 1920x1080) captured in 70 different scenarios. With intensive amount of effort, our dataset provides 20,800 people trajectories with 4.8 million head annotations and several video-level attributes in sequences. Extensive experiments are conducted on two challenging public datasets, i.e., Shanghaitech and UCF-QNRF, and our DroneCrowd, to demonstrate that STANet achieves favorable performance against the state-of-the-arts. The datasets and codes can be found at <a class="link-external link-https" href="https://github.com/VisDrone" rel="external noopener nofollow">this https URL</a>.

SkyNet: Multi-Drone Cooperation for Real-Time Person Identification and Localization.

A Training-time Friendly Network for Real-time Drone Detection.

A Drone Localization System Based On Multiple Time Delays Fusion

Fast Detection and Recognition Method of UAV in Sky Background

Real-Time Drone Detection Using Deep Learning Approach.

An Acoustic-Based Surveillance System for Amateur Drones Detection and Localization

Collaborative Localization of Aerial and Ground Mobile Robots Through Orthomosaic Map

Collaborative Recognition of Feasible Region with Aerial and Ground Robots Through DPCN

Instance Implant-Aided Non-uniformly Cropping for Person Detection in Aerial Images

Air-CAD: Edge-Assisted Multi-Drone Network for Real-time Crowd Anomaly Detection

Eye in the Sky: Drone-Based Object Tracking and 3D Localization

Lightweight Multi-Drone Detection and 3D-Localization via YOLO

Drone-based Joint Density Map Estimation, Localization and Tracking with Space-Time Multi-Scale Attention Network

Drone identification based on CenterNet-TensorRT

SkyNet: a Hardware-Efficient Method for Object Detection and Tracking on Embedded Systems

Multi-Stage Fusion Architecture for Small-Drone Localization and Identification Using Passive RF and EO Imagery: A Case Study

Eye in the Sky: Real-time Drone Surveillance System (DSS) for Violent Individuals Identification using ScatterNet Hybrid Deep Learning Network

Hybrid receptive field network for small object detection on drone view

Real-Time Object Localization Using a Fuzzy Controller for a Vision-Based Drone

On Onboard LiDAR-based Flying Object Detection

DronePose: The identification, segmentation, and orientation detection of drones via neural networks