Abstract:Data augmentation methods offer a cost-effective and efficient alternative to the acquisition of additional data, significantly enhancing data diversity and model generalization, making them particularly favored in object detection tasks. However, existing data augmentation techniques primarily focus on the visible spectrum and are directly applied to RGB-T object detection tasks, overlooking the inherent differences in image data between the two tasks. Visible images capture rich color and texture information during the daytime, while infrared images are capable of imaging under low-light complex scenarios during the nighttime. By integrating image information from both modalities, their complementary characteristics can be exploited to improve the overall effectiveness of data augmentation methods. To address this, we propose a cross-modality data augmentation method tailored for RGB-T object detection, leveraging masked image modeling within representation learning. Specifically, we focus on the temporal consistency of infrared images and combine them with visible images under varying lighting conditions for joint data augmentation, thereby enhancing the realism of the augmented images. Utilizing the masked image modeling method, we reconstruct images by integrating multimodal features, achieving cross-modality data augmentation in feature space. Additionally, we investigate the differences and complementarities between data augmentation methods in data space and feature space. Building upon existing theoretical foundations, we propose an integrative framework that combines these methods for improved augmentation effectiveness. Furthermore, we address the slow convergence observed with the existing Mosaic method in aerial imagery by introducing a multi-scale training strategy and proposing a full-scale Mosaic method as a complement. This optimization significantly accelerates network convergence. The experimental results validate the effectiveness of our proposed method and highlight its potential for further advancements in cross-modality object detection tasks.

A Novel Data Augmentation Method for Detection of Specific Aircraft in Remote Sensing RGB Images.

A Data Augmentation Strategy Based on Simulated Samples for Ship Detection in RGB Remote Sensing Images

A Novel Dataset and Detection Method for Unmanned Aerial Vehicles Using an Improved YOLOv9 Algorithm

Synthetic Data Augmentation Using Multiscale Attention CycleGAN for Aircraft Detection in Remote Sensing Images

Robust Augmentations for Small Object Detection of Aerial Images

Research on Aerial Photography Target Detection Methods

Rapid Airplane Detection in Remote Sensing Images Based on Multilayer Feature Fusion in Fully Convolutional Neural Networks.

Unsupervised Aircraft Detection in SAR Images with Image-Level Domain Adaption from Optical Images

Remote Sensing Aircraft Detection Method Based on Lightweight YOLOv4

Aircraft Detection Method Based on Deep Convolutional Neural Network for Remote Sensing Images

Cross-Modality Data Augmentation for Aerial Object Detection with Representation Learning

A Novel Data Augmentation Method for Sea Ice Scene Classification of Arctic Aerial Images.

Augmented Imagefication: A Data-driven Fault Detection Method for Aircraft Air Data Sensors

End-to-End Airplane Detection Using Transfer Learning in Remote Sensing Images

AMRNet: Chips Augmentation in Aerial Images Object Detection

A Review of Data Augmentation Methods of Remote Sensing Image Target Recognition

Small aircraft detection in infrared aerial imagery based on deep neural network

A Novel Method of Aircraft Detection under Complex Background Based on Circular Intensity Filter and Rotation Invariant Feature

Multi-Scale DenseNets-Based Aircraft Detection from Remote Sensing Images

Yolm: a remote sensing aircraft detection model

Two-stage Airplane Detection with NMS Filtering in Remote Sensing Images