Abstract:Unmanned Aerial Vehicles (UAVs) rely on satellite systems for stable positioning. However, due to limited satellite coverage or communication disruptions, UAVs may lose signals from satellite-based positioning systems. In such situations, vision-based techniques can serve as an alternative, ensuring the self-positioning capability of UAVs. However, most of the existing datasets are developed for the geo-localization tasks of the objects identified by UAVs, rather than the self-positioning task of UAVs. Furthermore, the current UAV datasets use discrete sampling on synthetic data, such as Google Maps, thereby neglecting the crucial aspects of dense sampling and the uncertainties commonly experienced in real-world scenarios. To address these issues, this paper presents a new dataset, DenseUAV, which is the first publicly available dataset designed for the UAV self-positioning task. DenseUAV adopts dense sampling on UAV images obtained in low-altitude urban settings. In total, over 27K UAV-view and satellite-view images of 14 university campuses are collected and annotated, establishing a new benchmark. In terms of model development, we first verify the superiority of Transformers over CNNs in this task. Then, we incorporate metric learning into representation learning to enhance the discriminative capacity of the model and to lessen the modality discrepancy. Besides, to facilitate joint learning from both perspectives, we propose a mutually supervised learning approach. Last, we enhance the Recall@K metric and introduce a new measurement, SDM@K, to evaluate the performance of a trained model from both the retrieval and localization perspectives simultaneously. As a result, the proposed baseline method achieves a remarkable Recall@1 score of 83.05% and an SDM@1 score of 86.24% on DenseUAV. The dataset and code will be made publicly available on <a class="link-external link-https" href="https://github.com/Dmmm1997/DenseUAV" rel="external noopener nofollow">this https URL</a>.

The Unmanned Aerial Vehicle Benchmark: Object Detection, Tracking and Baseline

The Unmanned Aerial Vehicle Benchmark: Object Detection and Tracking

WebUAV-3 M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Tracking

WebUAV-3M: A Benchmark for Unveiling the Power of Million-Scale Deep UAV Tracking

UAVSwarm Dataset: An Unmanned Aerial Vehicle Swarm Dataset for Multiple Object Tracking

UAV3D: A Large-scale 3D Perception Benchmark for Unmanned Aerial Vehicles

Anti-UAV: A Large-Scale Benchmark for Vision-Based UAV Tracking

UAV-Human: A Large Benchmark for Human Behavior Understanding with Unmanned Aerial Vehicles

Anti-UAV410: A Thermal Infrared Benchmark and Customized Scheme for Tracking Drones in the Wild.

A Novel Dataset and Detection Method for Unmanned Aerial Vehicles Using an Improved YOLOv9 Algorithm

A Benchmark for UAV-View Natural Language-Guided Tracking

Unmanned Aerial Vehicle Visual Detection and Tracking using Deep Neural Networks: A Performance Benchmark

An Empirical Study of Multi-Scale Object Detection in High Resolution UAV Images

Online Single Person Tracking For Unmanned Aerial Vehicles: Benchmark And New Baseline

Object Tracking in Unmanned Aerial Vehicle Videos via Multifeature Discrimination and Instance-Aware Attention Network

OLOD: a new UAV dataset and benchmark for single tiny object tracking

UAVData: A dataset for unmanned aerial vehicle detection

Learning-based Object Detection in High Resolution UAV Images - An Empirical Study.

Vision-Based UAV Self-Positioning in Low-Altitude Urban Environments

Evidential Detection and Tracking Collaboration: New Problem, Benchmark and Algorithm for Robust Anti-UAV System

BioDrone: A Bionic Drone-Based Single Object Tracking Benchmark for Robust Vision