Abstract:Mix-up is a key technique for consistency regularization-based semi-supervised learning methods, generating strong-perturbed samples for strong-weak pseudo-supervision. Existing mix-up operations are performed either randomly or with predefined rules, such as replacing low-confidence patches with high-confidence ones. The former lacks control over the perturbation degree, leading to overfitting on randomly perturbed samples, while the latter tends to generate images with trivial perturbations, both of which limit the effectiveness of consistency learning. This paper aims to answer the following question: How can image mix-up perturbation be adaptively performed during training? To this end, we propose an Adaptive Mix algorithm (AdaMix) for image mix-up in a self-paced learning manner. Given that, in general, a model's performance gradually improves during training, AdaMix is equipped with a self-paced curriculum that, in the initial training stage, provides relatively simple perturbed samples and then gradually increases the difficulty of perturbed images by adaptively controlling the perturbation degree based on the model's learning state estimated by a self-paced regularize. We develop three frameworks with our AdaMix, i.e., AdaMix-ST, AdaMix-MT, and AdaMix-CT, for semi-supervised medical image segmentation. Extensive experiments on three public datasets, including both 2D and 3D modalities, show that the proposed frameworks are capable of achieving superior performance. For example, compared with the state-of-the-art, AdaMix-CT achieves relative improvements of 2.62% in Dice and 48.25% in average surface distance on the ACDC dataset with 10% labeled data. The results demonstrate that mix-up operations with dynamically adjusted perturbation strength based on the segmentation model's state can significantly enhance the effectiveness of consistency regularization.

S3Mix: Same Category Same Semantics Mixing for Augmenting Fine-grained Images

SnapMix: Semantically Proportional Mixing for Augmenting Fine-grained Data

ResizeMix: Mixing Data with Preserved Object Information and True Labels

SpliceMix: A Cross-scale and Semantic Blending Augmentation Strategy for Multi-label Image Classification.

SUMix: Mixup with Semantic and Uncertain Information

TransformMix: Learning Transformation and Mixing Strategies from Data

Attribute Mix: Semantic Data Augmentation for Fine Grained Recognition

Semantic Equivariant Mixup

SynerMix: Synergistic Mixup Solution for Enhanced Intra-Class Cohesion and Inter-Class Separability in Image Classification

Decoupled Mixup for Data-efficient Learning

MiAMix: Enhancing Image Classification through a Multi-stage Augmented Mixed Sample Data Augmentation Method

Global Mixup: Eliminating Ambiguity with Clustering.

Adaptive Mix for Semi-Supervised Medical Image Segmentation

Region Mixup

ITMix: Image-Text Mix Augmentation for Transferring CLIP to Image Classification

Un-mix: Rethinking Image Mixtures for Unsupervised Visual Representation Learning

Decoupled Data Augmentation for Improving Image Classification

SMMix: Self-Motivated Image Mixing for Vision Transformers

Gradsalmix: gradient saliency-based mix for image data augmentation

Unveiling the Power of Mixup for Stronger Classiﬁers

NeighborMix Data Augmentation for Image Recognition