Abstract:Introduction Artificial Intelligence (AI) has proven effective in classifying skin cancers using dermoscopy images. In experimental settings, algorithms have outperformed expert dermatologists in classifying melanoma and keratinocyte cancers. However, clinical application is limited when algorithms are presented with ‘untrained’ or out-of-distribution lesion categories, often misclassifying benign lesions as malignant, or misclassifying malignant lesions as benign. Another limitation often raised is the lack of clinical context (e.g., medical history) used as input for the AI decision process. The increasing use of Total Body Photography (TBP) in clinical examinations presents new opportunities for AI to perform holistic analysis of the whole patient, rather than a single lesion. Currently there is a lack of existing literature or standards for image annotation of TBP, or on preserving patient privacy during the machine learning process. Methods This protocol describes the methods for the acquisition of patient data, including TBP, medical history, and genetic risk factors, to create a comprehensive dataset for machine learning. 500 patients of various risk profiles will be recruited from two clinical sites (Australia and Spain), to undergo temporal total body imaging, complete surveys on sun behaviors and medical history, and provide a DNA sample. This patient-level metadata is applied to image datasets using DICOM labels. Anonymization and masking methods are applied to preserve patient privacy. A two-step annotation process is followed to label skin images for lesion detection and classification using deep learning models. Skin phenotype characteristics are extracted from images, including innate and facultative skin color, nevi distribution, and UV damage. Several algorithms will be developed relating to skin lesion detection, segmentation and classification, 3D mapping, change detection, and risk profiling. Simultaneously, explainable AI (XAI) methods will be incorporated to foster clinician and patient trust. Additionally, a publicly released dataset of anonymized annotated TBP images will be released for an international challenge to advance the development of new algorithms using this type of data. Conclusion The anticipated results from this protocol are validated AI-based tools to provide holistic risk assessment for individual lesions, and risk stratification of patients to assist clinicians in monitoring for skin cancer.

S-SYNTH: Knowledge-Based, Synthetic Generation of Skin Images

Skin Image Synthesis Based on Physical Model

DermSynth3D: Synthesis of in-the-wild Annotated Dermatology Images

DermSynth3D : Synthesis of in-the-wild annotated dermatology images

Cancer-Net SCa-Synth: An Open Access Synthetically Generated 2D Skin Lesion Dataset for Skin Cancer Classification

DermGAN: Synthetic Generation of Clinical Skin Images with Pathology

Revamping AI Models in Dermatology: Overcoming Critical Challenges for Enhanced Skin Lesion Diagnosis

Deep Convolutional Generative Adversarial Networks to Enhance Artificial Intelligence in Healthcare: A Skin Cancer Application

Augmenting medical image classifiers with synthetic data from latent diffusion models

Generating Synthetic Data for Medical Imaging

Finetuning of GLIDE stable diffusion model for AI-based text-conditional image synthesis of dermoscopic images

From Data to Diagnosis: Skin Cancer Image Datasets for Artificial Intelligence

Generating Synthetic Images Using Stable Diffusion Model for Skin Lesion Classification

Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedback

SyntheX: Scaling Up Learning-based X-ray Image Analysis Through In Silico Experiments

Diffusion-based Data Augmentation for Skin Disease Classification: Impact Across Original Medical Datasets to Fully Synthetic Images

A protocol for annotation of total body photography for machine learning to analyze skin phenotype and lesion classification

Synthetic Generation of Dermatoscopic Images with GAN and Closed-Form Factorization

AI-Skin : Skin Disease Recognition based on Self-learning and Wide Data Collection through a Closed Loop Framework

Knowledge-based in silico models and dataset for the comparative evaluation of mammography AI for a range of breast characteristics, lesion conspicuities and doses

SYNTA: A novel approach for deep learning-based image analysis in muscle histopathology using photo-realistic synthetic data