Abstract:Data augmentation is a critical technique in object detection, especially the augmentations targeting at scale invariance training (scale-aware augmentation). However, there has been little systematic investigation of how to design scale-aware data augmentation for object detection. We propose Scale-aware AutoAug to learn data augmentation policies for object detection. We define a new scale-aware search space, where both image- and instance-level augmentations are designed for maintaining scale robust feature learning. Upon this search space, we propose a new search metric, termed Pareto Scale Balance, to facilitate efficient augmentation policy search. In experiments, Scale-aware AutoAug yields significant and consistent improvement on various object detectors (e.g., RetinaNet, Faster R-CNN, Mask R-CNN, and FCOS), even compared with strong multi-scale training baselines. Our searched augmentation policies are generalized well to other datasets and instance-level tasks beyond object detection, e.g., instance segmentation. The search cost is much less than previous automated augmentation approaches for object detection, i.e., 8 GPUs across 2.5 days versus. 800 TPU-days. In addition, meaningful patterns can be summarized from our searched policies, which intuitively provide valuable knowledge for hand-crafted data augmentation design. Based on the searched scale-aware augmentation policies, we further introduce a dynamic training paradigm to adaptively determine specific augmentation policy usage during training. The dynamic paradigm consists of an heuristic manner for image-level augmentations and a differentiable copy-paste-based method for instance-level augmentations. The dynamic paradigm achieves further performance improvements to Scale-aware AutoAug without any additional burden on the long tailed LVIS benchmarks. We also demonstrate its ability to prevent over-fitting for large models, e.g., the Swin Transformer large model. Code and models are available at https://github.com/dvlab-research/SA-AutoAug.

A Unified Search Framework for Data Augmentation and Neural Architecture on Small-scale Image Datasets

Auto Machine Learning for Medical Image Analysis by Unifying the Search on Data Augmentation and Neural Architecture

Boosting Unsupervised Contrastive Learning Using Diffusion-Based Data Augmentation from Scratch

Deep AutoAugment

DAAS: Differentiable Architecture and Augmentation Policy Search

AutoAugment: Learning Augmentation Policies from Data

A Good Data Augmentation Policy Is Not All You Need: A Multi-Task Learning Perspective

Enabling Data Diversity: Efficient Automatic Augmentation via Regularized Adversarial Training

Automatic Data Augmentation for 3D Medical Image Segmentation

Local Patch AutoAugment with Multi-Agent Collaboration

Scale-aware Automatic Augmentations for Object Detection with Dynamic Training

Automatic Data Augmentation by Learning the Deterministic Policy

Population Based Augmentation: Efficient Learning of Augmentation Policy Schedules

Data-Efficient Augmentation for Training Neural Networks

ALADA: A lite automatic data augmentation framework for industrial defect detection

Universal Adaptive Data Augmentation

Randaugment: Practical automated data augmentation with a reduced search space

MetaAugment: Sample-Aware Data Augmentation Policy Learning

Automatic Data Augmentation for Medical Image Segmentation Using Adaptive Sequence-length Based Deep Reinforcement Learning

Learning Optimal Data Augmentation Policies via Bayesian Optimization for Image Classification Tasks

A Survey of Automated Data Augmentation Algorithms for Deep Learning-based Image Classification Tasks