Abstract:In this paper we report on improved part segmentation performance using convolutional neural networks to reduce the dependency on the large amount of manually annotated empirical images. This was achieved by optimising the visual realism of synthetic agricultural <a class="link-external link-http" href="http://images.In" rel="external noopener nofollow">this http URL</a> Part I, a cycle consistent generative adversarial network was applied to synthetic and empirical images with the objective to generate more realistic synthetic images by translating them to the empirical domain. We first hypothesise and confirm that plant part image features such as color and texture become more similar to the empirical domain after translation of the synthetic <a class="link-external link-http" href="http://images.Results" rel="external noopener nofollow">this http URL</a> confirm this with an improved mean color distribution correlation with the empirical data prior of 0.62 and post translation of 0.90. Furthermore, the mean image features of contrast, homogeneity, energy and entropy moved closer to the empirical mean, post translation. In Part II, 7 experiments were performed using convolutional neural networks with different combinations of synthetic, synthetic translated to empirical and empirical images. We hypothesised that the translated images can be used for (i) improved learning of empirical images, and (ii) that learning without any fine-tuning with empirical images is improved by bootstrapping with translated images over bootstrapping with synthetic images. Results confirm our second and third hypotheses. First a maximum intersection-over-union performance was achieved of 0.52 when bootstrapping with translated images and fine-tuning with empirical images; an 8% increase compared to only using synthetic images. Second, training without any empirical fine-tuning resulted in an average IOU of 0.31; a 55% performance increase over previous methods that only used synthetic images.

The Unmet Promise of Synthetic Training Images: Using Retrieved Real Images Performs Better

Image‐level Dataset Synthesis with an End‐to‐end Trainable Framework

Is Synthetic Image Useful for Transfer Learning? An Investigation into Data Generation, Volume, and Utilization

Diversify, Don't Fine-Tune: Scaling Up Visual Recognition Training with Synthetic Images

Improving the Effectiveness of Deep Generative Data

Is synthetic data from generative models ready for image recognition?

Scaling Laws of Synthetic Images for Model Training ... for Now

Beyond Photo Realism for Domain Adaptation from Synthetic Data

StableRep: Synthetic Images from Text-to-Image Models Make Strong Visual Representation Learners

Analyzing Effects of Fake Training Data on the Performance of Deep Learning Systems

Fake it till you make it: Learning transferable representations from synthetic ImageNet clones

AnySynth: Harnessing the Power of Image Synthetic Data Generation for Generalized Vision-Language Tasks

Synthetic Data for Model Selection

Is Synthetic Data all We Need? Benchmarking the Robustness of Models Trained with Synthetic Images

From Fake to Real: Pretraining on Balanced Synthetic Images to Prevent Spurious Correlations in Image Recognition

Feedback-guided Data Synthesis for Imbalanced Classification

How Good Are Synthetic Medical Images? An Empirical Study with Lung Ultrasound

A Study on Improving Realism of Synthetic Data for Machine Learning

Improved Part Segmentation Performance by Optimising Realism of Synthetic Images using Cycle Generative Adversarial Networks

Real-Fake: Effective Training Data Synthesis Through Distribution Matching

Mind the Gap Between Synthetic and Real: Utilizing Transfer Learning to Probe the Boundaries of Stable Diffusion Generated Data