Abstract:Visual detection of Micro Air Vehicles (MAVs) has attracted increasing attention in recent years due to its important application in various tasks. The existing methods for MAV detection assume that the training set and testing set have the same distribution. As a result, when deployed in new domains, the detectors would have a significant performance degradation due to domain discrepancy. In this paper, we study the problem of cross-domain MAV detection. The contributions of this paper are threefold. 1) We propose a Multi-MAV-Multi-Domain (M3D) dataset consisting of both simulation and realistic images. Compared to other existing datasets, the proposed one is more comprehensive in the sense that it covers rich scenes, diverse MAV types, and various viewing angles. A new benchmark for cross-domain MAV detection is proposed based on the proposed dataset. 2) We propose a Noise Suppression Network (NSN) based on the framework of pseudo-labeling and a large-to-small training procedure. To reduce the challenging pseudo-label noises, two novel modules are designed in this network. The first is a prior-based curriculum learning module for allocating adaptive thresholds for pseudo labels with different difficulties. The second is a masked copy-paste augmentation module for pasting truly-labeled MAVs on unlabeled target images and thus decreasing pseudo-label noises. 3) Extensive experimental results verify the superior performance of the proposed method compared to the state-of-the-art ones. In particular, it achieves mAP of 46.9%(+5.8%), 50.5%(+3.7%), and 61.5%(+11.3%) on the tasks of simulation-to-real adaptation, cross-scene adaptation, and cross-camera adaptation, respectively. Note to Practitioners— To study the cross-domain MAV detection problem, this paper establishes a novel benchmark that consists of three domain adaptation tasks: simulation-to-real adaptation, cross-scene adaptation, and cross-camera adaptation, respectively. The benchmark is based on a novel MAV dataset called Multi-MAV-Multi-Domain (M3D), which is available at: https://github.com/WestlakeAerialRobotics/M3D. To reduce the noises caused by pseudo labels, a noise suppression network is proposed to overcome the error accumulation. Extensive experiments are conducted to prove the effectiveness of the proposed approach.

Domain Adaptive Detection of MAVs: A Benchmark and Noise Suppression Network

Domain Adaptive Detection of MAVs: A Benchmark and Noise Suppression Network

Multi-View Domain Adaptive Object Detection on Camera Networks.

Global-Local MAV Detection under Challenging Conditions based on Appearance and Motion

Multiview Aerial Visual Recognition (MAVREC): Can Multi-view Improve Aerial Visual Perception?

Adaptation Via Proxy: Building Instance-Aware Proxy for Unsupervised Domain Adaptive 3d Object Detection

BEVUDA: Multi-geometric Space Alignments for Domain Adaptive BEV 3D Object Detection

Unsupervised Domain Adaptive 3D Detection with Multi-Level Consistency

Drone Detection Method Based on MobileViT and CA-PANet

M&M3D: Multi-Dataset Training and Efficient Network for Multi-view 3D Object Detection

Hierarchical alignment network for domain adaptive object detection in aerial images

Detection, Localization, and Tracking of Multiple MAVs With Panoramic Stereo Camera Networks

MAVNet: an Effective Semantic Segmentation Micro-Network for MAV-based Tasks

Multi-Scale And Occlusion Aware Network For Vehicle Detection And Segmentation On Uav Aerial Images

Revisiting Cross-Domain Problem for LiDAR-based 3D Object Detection

An Adaptive Multimodal Fusion 3D Object Detection Algorithm for Unmanned Systems in Adverse Weather

BEV-MAE: Bird's Eye View Masked Autoencoders for Point Cloud Pre-training in Autonomous Driving Scenarios

Open-Scenario Domain Adaptive Object Detection in Autonomous Driving

RemoteDet-Mamba: A Hybrid Mamba-CNN Network for Multi-modal Object Detection in Remote Sensing Images

Vehicle Detection in UAV Images via Background Suppression Pyramid Network and Multi-Scale Task Adaptive Decoupled Head

A Domain Adaptation Method for Object Detection in UAV Based on Semi-Supervised Learning