Abstract:This paper proposes a space-time multi-scale attention network (STANet) to solve density map estimation, localization and tracking in dense crowds of video clips captured by drones with arbitrary crowd density, perspective, and flight altitude. Our STANet method aggregates multi-scale feature maps in sequential frames to exploit the temporal coherency, and then predict the density maps, localize the targets, and associate them in crowds simultaneously. A coarse-to-fine process is designed to gradually apply the attention module on the aggregated multi-scale feature maps to enforce the network to exploit the discriminative space-time features for better performance. The whole network is trained in an end-to-end manner with the multi-task loss, formed by three terms, i.e., the density map loss, localization loss and association loss. The non-maximal suppression followed by the min-cost flow framework is used to generate the trajectories of targets' in scenarios. Since existing crowd counting datasets merely focus on crowd counting in static cameras rather than density map estimation, counting and tracking in crowds on drones, we have collected a new large-scale drone-based dataset, DroneCrowd, formed by 112 video clips with 33,600 high resolution frames (i.e., 1920x1080) captured in 70 different scenarios. With intensive amount of effort, our dataset provides 20,800 people trajectories with 4.8 million head annotations and several video-level attributes in sequences. Extensive experiments are conducted on two challenging public datasets, i.e., Shanghaitech and UCF-QNRF, and our DroneCrowd, to demonstrate that STANet achieves favorable performance against the state-of-the-arts. The datasets and codes can be found at <a class="link-external link-https" href="https://github.com/VisDrone" rel="external noopener nofollow">this https URL</a>.

Air-CAD: Edge-Assisted Multi-Drone Network for Real-time Crowd Anomaly Detection

A Training-time Friendly Network for Real-time Drone Detection.

A Crowdsensing-based Cyber-physical System for Drone Surveillance Using Random Finite Set Theory

Collaborative Recognition of Feasible Region with Aerial and Ground Robots Through DPCN

DroneNet: Rescue Drone-View Object Detection

Adaptive Switching Spatial-Temporal Fusion Detection for Remote Flying Drones

A Flow Base Bi-path Network for Cross-scene Video Crowd Understanding in Aerial View

CEDAR: A Cost-Effective Crowdsensing System for Detecting and Localizing Drones

SkyNet: Multi-Drone Cooperation for Real-Time Person Identification and Localization.

Detection, Tracking, and Counting Meets Drones in Crowds: A Benchmark

LiDAR-based Outdoor Crowd Management for Smart Campus on the Edge

Drone identification based on CenterNet-TensorRT

CAD-Net: A Context-Aware Detection Network for Objects in Remote Sensing Imagery

Fast Drone Detection with Optimized Feature Capture and Modeling Algorithms

UCDNet: Multi-UAV Collaborative 3D Object Detection Network by Reliable Feature Mapping

Drone-based Joint Density Map Estimation, Localization and Tracking with Space-Time Multi-Scale Attention Network

Rethinking Drone-Based Search and Rescue with Aerial Person Detection

Towards Intelligent Mobile Crowdsensing With Task State Information Sharing over Edge-Assisted UAV Networks

Combined Person Classification with Airborne Optical Sectioning

A Multitask Cascading CNN with MultiScale Infrared Optical Flow Feature Fusion-Based Abnormal Crowd Behavior Monitoring UAV

Toward More Robust and Real-Time Unmanned Aerial Vehicle Detection and Tracking via Cross-Scale Feature Aggregation Based on the Center Keypoint.