Abstract:We investigate the efficacy of data augmentations to close the domain gap in spaceborne computer vision, crucial for autonomous operations like on-orbit servicing. As the use of computer vision in space increases, challenges such as hostile illumination and low signal-to-noise ratios significantly hinder performance. While learning-based algorithms show promising results, their adoption is limited by the need for extensive annotated training data and the domain gap that arises from differences between synthesized and real-world imagery. This study explores domain generalization in terms of data augmentations -- classical color and geometric transformations, corruptions, and noise -- to enhance model performance across the domain gap. To this end, we conduct an large scale experiment using a hyperparameter optimization pipeline that samples hundreds of different configurations and searches for the best set to bridge the domain gap. As a reference task, we use 2D object detection and evaluate on the SPEED+ dataset that contains real hardware-in-the-loop satellite images in its test set. Moreover, we evaluate four popular object detectors, including Mask R-CNN, Faster R-CNN, YOLO-v7, and the open set detector GroundingDINO, and highlight their trade-offs between performance, inference speed, and training time. Our results underscore the vital role of data augmentations in bridging the domain gap, improving model performance, robustness, and reliability for critical space applications. As a result, we propose two novel data augmentations specifically developed to emulate the visual effects observed in orbital imagery. We conclude by recommending the most effective augmentations for advancing computer vision in challenging orbital environments. Code for training detectors and hyperparameter search will be made publicly available.

Category-Oriented Adversarial Data Augmentation Via Statistic Similarity for Satellite Images

A Novel Multi-Sample Data Augmentation Method for Oriented Object Detection in Remote Sensing Images

Target Recognition in SAR Images by Deep Learning with Training Data Augmentation

AdvMask: A Sparse Adversarial Attack Based Data Augmentation Method for Image Classification

A Review of Data Augmentation Methods of Remote Sensing Image Target Recognition

Robust and Accurate Object Detection via Adversarial Learning

ADA: Adversarial Data Augmentation for Object Detection

Adaptive Data Augmentation Training Method for SAR Military Target Classification

Image Data Augmentation for Deep Learning: A Survey

Enhancing Monocular 3-D Object Detection Through Data Augmentation Strategies

Enabling Data Diversity: Efficient Automatic Augmentation via Regularized Adversarial Training

Optimizing Few-Shot Remote Sensing Scene Classification Based on an Improved Data Augmentation Approach

Object-Based Augmentation Improves Quality of Remote Sensing Semantic Segmentation

How Important are Data Augmentations to Close the Domain Gap for Object Detection in Orbit?

ADASSM: Adversarial Data Augmentation in Statistical Shape Models From Images

Physical-Related Feature Extraction From Simulated SAR Image Based on the Adversarial Encoding Network for Data Augmentation

BSDA: Bayesian Random Semantic Data Augmentation for Medical Image Classification

Adversarial Defense Teacher for Cross-Domain Object Detection under Poor Visibility Conditions

Improving satellite image classification accuracy using GAN-based data augmentation and vision transformers

Learning Critical Features for Arbitrary-Oriented Object Detection in Remote-Sensing Optical Images

Tied-Augment: Controlling Representation Similarity Improves Data Augmentation