Abstract:Deep convolutional neural networks perform well in the field of computer vision, but exhibit undesirable behaviors such as memorization and sensitivity to adversarial examples. Therefore, proper regularization strategies are needed to alleviate these problems. Currently, regularization strategies with mixed sample data augmentation perform very well, and these algorithms allow the network to generalize better, improve the baseline performance of the model. However, interpolation-based mixed sample data augmentation distorts the data distribution, while masking-based mixed sample data augmentation results in excessive information loss for overly regular shapes of masks. Although mixed sample data augmentation is proven to be an effective method to improve the baseline performance, generalization ability and robustness of deep convolutional models, there is still room for improvement in terms of maintaining the of image local consistency and image data distribution. In this paper, we propose a new mixed sample data augmentation-LMix, which uses random masking to increase the number of masks in the image to maintain the data distribution, and high-frequency filtering to sharpen the image to highlight recognition regions. We applied the method to train CIFAR-10, CIFAR-100, SVHN, and Tiny-ImageNet datasets under the PreAct-ResNet18 model to evaluate the method, and obtained the latest results of 96.32, 79.85, 97.01, and 64.16%, respectively, which are 1.70, 4.73, and 8.06% higher than the optimal baseline accuracy. The LMix algorithm improves the generalization ability of the state-of-the-art neural network architecture and enhances the robustness to adversarial samples.

PatchMix: patch-level mixup for data augmentation in convolutional neural networks

PointPatchMix: Point Cloud Mixing with Patch Scoring

Evolving Image Compositions for Feature Representation Learning

Global Mixup: Eliminating Ambiguity with Clustering.

TransformMix: Learning Transformation and Mixing Strategies from Data

ResizeMix: Mixing Data with Preserved Object Information and True Labels

Data Augmentation Using Mixup and Random Erasing

LMix:Regularization Strategy for Convolutional Neural Networks

NeighborMix Data Augmentation for Image Recognition

MiAMix: Enhancing Image Classification through a Multi-stage Augmented Mixed Sample Data Augmentation Method

CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features

A New Data Augmentation Method Based on Mixup and Dempster-Shafer Theory

ColMix -- A Simple Data Augmentation Framework to Improve Object Detector Performance and Robustness in Aerial Images

DiffuseMix: Label-Preserving Data Augmentation with Diffusion Models

LMix: Regularization Strategy for Convolutional Neural Networks.

WeMix: How to Better Utilize Data Augmentation

Provable Benefit of Cutout and CutMix for Feature Learning

Mixup Augmentation with Multiple Interpolations

Patch Mix Augmentation with Dual Encoders for Meta-Learning

CRmix: A Regularization by Clipping Images and Replacing Mixed Samples for Imbalanced Classification

RandoMix: a mixed sample data augmentation method with multiple mixed modes