Abstract:Visual detection of Micro Air Vehicles (MAVs) has attracted increasing attention in recent years due to its important application in various tasks. The existing methods for MAV detection assume that the training set and testing set have the same distribution. As a result, when deployed in new domains, the detectors would have a significant performance degradation due to domain discrepancy. In this paper, we study the problem of cross-domain MAV detection. The contributions of this paper are threefold. 1) We propose a Multi-MAV-Multi-Domain (M3D) dataset consisting of both simulation and realistic images. Compared to other existing datasets, the proposed one is more comprehensive in the sense that it covers rich scenes, diverse MAV types, and various viewing angles. A new benchmark for cross-domain MAV detection is proposed based on the proposed dataset. 2) We propose a Noise Suppression Network (NSN) based on the framework of pseudo-labeling and a large-to-small training procedure. To reduce the challenging pseudo-label noises, two novel modules are designed in this network. The first is a prior-based curriculum learning module for allocating adaptive thresholds for pseudo labels with different difficulties. The second is a masked copy-paste augmentation module for pasting truly-labeled MAVs on unlabeled target images and thus decreasing pseudo-label noises. 3) Extensive experimental results verify the superior performance of the proposed method compared to the state-of-the-art ones. In particular, it achieves mAP of 46.9%(+5.8%), 50.5%(+3.7%), and 61.5%(+11.3%) on the tasks of simulation-to-real adaptation, cross-scene adaptation, and cross-camera adaptation, respectively. Note to Practitioners— To study the cross-domain MAV detection problem, this paper establishes a novel benchmark that consists of three domain adaptation tasks: simulation-to-real adaptation, cross-scene adaptation, and cross-camera adaptation, respectively. The benchmark is based on a novel MAV dataset called Multi-MAV-Multi-Domain (M3D), which is available at: https://github.com/WestlakeAerialRobotics/M3D. To reduce the noises caused by pseudo labels, a noise suppression network is proposed to overcome the error accumulation. Extensive experiments are conducted to prove the effectiveness of the proposed approach.

MAVNet: an Effective Semantic Segmentation Micro-Network for MAV-based Tasks

A Scalable Real-time Semantic Segmentation Network for Autonomous Driving

MDSNet: a Lightweight Network for Real-Time Vision Task on the Unmanned Mobile Robot

MLFNet: Multi-Level Fusion Network for Real-Time Semantic Segmentation of Autonomous Driving

MDRNet: a lightweight network for real-time semantic segmentation in street scenes

Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric Annotations

Towards Broad Learning Networks on Unmanned Mobile Robot for Semantic Segmentation

A Novel Mamba Architecture with a Semantic Transformer for Efficient Real-Time Remote Sensing Semantic Segmentation

Lightweight Real-Time Image Semantic Segmentation Network Based on Multi-Resolution Hybrid Attention Mechanism

MFAFNet: A Lightweight and Efficient Network with Multi-Level Feature Adaptive Fusion for Real-Time Semantic Segmentation

Lightweight Semantic Segmentation Network for Semantic Scene Understanding on Low-Compute Devices

LiDAR-BEVMTN: Real-Time LiDAR Bird's-Eye View Multi-Task Perception Network for Autonomous Driving

MSCFNet: A Lightweight Network with Multi-Scale Context Fusion for Real-Time Semantic Segmentation

ELANet: an efficiently lightweight asymmetrical network for real-time semantic segmentation

Domain Adaptive Detection of MAVs: A Benchmark and Noise Suppression Network

LEDNet: A Lightweight Encoder-Decoder Network for Real-Time Semantic Segmentation

Asymmetric-Convolution-Guided Multipath Fusion for Real-Time Semantic Segmentation Networks

SegNet: A Segmented Deep Learning based Convolutional Neural Network Approach for Drones Wildfire Detection

In Defense of Pre-trained ImageNet Architectures for Real-time Semantic Segmentation of Road-driving Images

DroneSegNet: Robust Aerial Semantic Segmentation for UAV-Based IoT Applications

MDNet: A Multi-image Input Real-Time Semantic Segmentation Model with Decoupled Supervision