Abstract:Data augmentation is an effective technique for automatically expanding training data in deep learning. Brain-inspired methods are approaches that draw inspiration from the functionality and structure of the human brain and apply these mechanisms and principles to artificial intelligence and computer science. When there is a large style difference between training data and testing data, common data augmentation methods cannot effectively enhance the generalization performance of the deep model. To solve this problem, we improve modeling Domain Shifts with Uncertainty (DSU) and propose a new brain-inspired computer vision image data augmentation method which consists of two key components, namely, using Robust statistics and controlling the Coefficient of variance for DSU (RCDSU) and Feature Data Augmentation (FeatureDA). RCDSU calculates feature statistics (mean and standard deviation) with robust statistics to weaken the influence of outliers, making the statistics close to the real values and improving the robustness of deep learning models. By controlling the coefficient of variance, RCDSU makes the feature statistics shift with semantic preservation and increases shift range. FeatureDA controls the coefficient of variance similarly to generate the augmented features with semantics unchanged and increase the coverage of augmented features. RCDSU and FeatureDA are proposed to perform style transfer and content transfer in the feature space, and improve the generalization ability of the model at the style and content level respectively. On Photo, Art Painting, Cartoon, and Sketch (PACS) multi-style classification task, RCDSU plus FeatureDA achieves competitive accuracy. After adding Gaussian noise to PACS dataset, RCDSU plus FeatureDA shows strong robustness against outliers. FeatureDA achieves excellent results on CIFAR-100 image classification task. RCDSU plus FeatureDA can be applied as a novel brain-inspired semantic data augmentation method with implicit robot automation which is suitable for datasets with large style differences between training and testing data.

Style Transfer as Data Augmentation: A Case Study on Named Entity Recognition

Diversified Patch-based Style Transfer with Shifted Style Normalization

UATST: Towards Unpaired Arbitrary Text-Guided Style Transfer with Cross-Space Modulation

Data Augmentation for Cross-Domain Named Entity Recognition

Style Permutation for Diversified Arbitrary Style Transfer

Style Augmentation: Data Augmentation via Style Randomization

SASSL: Enhancing Self-Supervised Learning via Neural Style Transfer

Style Transfer in Text: Exploration and Evaluation

ST$^2$: Small-data Text Style Transfer via Multi-task Meta-Learning

Style Transfer as Unsupervised Machine Translation

Language Style Transfer from Sentences with Arbitrary Unknown Styles

Language Style Transfer from Non-Parallel Text with Arbitrary Styles

Synthesizing Data for Text Recognition with Style Transfer

DATG: Data Augmentation with Transformer-Based Generation for Low-Resource Named Entity Recognition

SimpleStyle: An Adaptable Style Transfer Approach

Exploring synthetic data for cross-speaker style transfer in style representation based TTS

Data Augmentation for Low-Resource Named Entity Recognition Using Backtranslation

Massive Styles Transfer with Limited Labeled Data

An Experimental Study on Data Augmentation Techniques for Named Entity Recognition on Low-Resource Domains

Brain-inspired semantic data augmentation for multi-style images

Syntax-driven Data Augmentation for Named Entity Recognition