Abstract:Significance: Deep learning (DL) models are being increasingly developed to map sensor data to the image domain directly. However, DL methodologies are data-driven and require large and diverse data sets to provide robust and accurate image formation performances. For research modalities such as 2D/3D diffuse optical imaging, the lack of large publicly available data sets and the wide variety of instrumentation designs, data types, and applications leads to unique challenges in obtaining well-controlled data sets for training and validation. Meanwhile, great efforts over the last four decades have focused on developing accurate and computationally efficient light propagation models that are flexible enough to simulate a wide variety of experimental conditions. Aim: Recent developments in Monte Carlo (MC)-based modeling offer the unique advantage of simulating accurately light propagation spatially, temporally, and over an extensive range of optical parameters, including minimally to highly scattering tissue within a computationally efficient platform. Herein, we demonstrate how such MC platforms, namely "Monte Carlo eXtreme" and "Mesh-based Monte Carlo," can be leveraged to generate large and representative data sets for training the DL model efficiently. Approach: We propose data generator pipeline strategies using these platforms and demonstrate their potential in fluorescence optical topography, fluorescence optical tomography, and single-pixel diffuse optical tomography. These applications represent a large variety in instrumentation design, sample properties, and contrast function. Results: DL models trained using the MC-based in silico datasets, validated further with experimental data not used during training, show accurate and promising results. Conclusion: Overall, these MC-based data generation pipelines are expected to support the development of DL models for rapid, robust, and user-friendly image formation in a wide variety of applications.

BlendTorch: A Real-Time, Adaptive Domain Randomization Library

Boosting Adversarial Training in Safety-Critical Systems Through Boundary Data Selection

Photo-realistic Neural Domain Randomization

Increasing the Robustness of Deep Learning Models for Object Segmentation: A Framework for Blending Automatically Annotated Real and Synthetic Data.

Object Detection Using Sim2Real Domain Randomization for Robotic Applications

Domain Randomization via Entropy Maximization

OpTorch: Optimized deep learning architectures for resource limited environments

FE-DaST: Fast and Effective Data-Free Substitute Training for Black-Box Adversarial Attacks

Out of Thin Air: Exploring Data-Free Adversarial Robustness Distillation

A Data-Centric Optimization Framework for Machine Learning

Beyond Photo Realism for Domain Adaptation from Synthetic Data

Back to the Source: Diffusion-Driven Adaptation to Test-Time Corruption

Back to the Source: Diffusion-Driven Test-Time Adaptation

Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion Distillation

Continual Domain Randomization

Combining Synthetic Images and Deep Active Learning: Data-Efficient Training of an Industrial Object Detection Model

BlenDA: Domain Adaptive Object Detection through diffusion-based blending

Monte Carlo-based data generation for efficient deep learning reconstruction of macroscopic diffuse optical tomography and topography applications

Randomize to Generalize: Domain Randomization for Runway FOD Detection

TorchGeo: Deep Learning With Geospatial Data

Diff-Mosaic: Augmenting Realistic Representations in Infrared Small Target Detection via Diffusion Prior