Abstract:Automated synthesis of histology images has several potential applications in computational pathology. However, no existing method can generate realistic tissue images with a bespoke cellular layout or user-defined histology parameters. In this work, we propose a novel framework called SynCLay (Synthesis from Cellular Layouts) that can construct realistic and high-quality histology images from user-defined cellular layouts along with annotated cellular boundaries. Tissue image generation based on bespoke cellular layouts through the proposed framework allows users to generate different histological patterns from arbitrary topological arrangement of different types of cells (e.g., neutrophils, lymphocytes, epithelial cells and others). SynCLay generated synthetic images can be helpful in studying the role of different types of cells present in the tumor microenvironment. Additionally, they can assist in balancing the distribution of cellular counts in tissue images for designing accurate cellular composition predictors by minimizing the effects of data imbalance. We train SynCLay in an adversarial manner and integrate a nuclear segmentation and classification model in its training to refine nuclear structures and generate nuclear masks in conjunction with synthetic images. During inference, we combine the model with another parametric model for generating colon images and associated cellular counts as annotations given the grade of differentiation and cellularities (cell densities) of different cells. We assess the generated images quantitatively using the Frechet Inception Distance and report on feedback from trained pathologists who assigned realism scores to a set of images generated by the framework. The average realism score across all pathologists for synthetic images was as high as that for the real images. Moreover, with the assistance from pathologists, we showcase the ability of the generated images to accurately differentiate between benign and malignant tumors, thus reinforcing their reliability. We demonstrate that the proposed framework can be used to add new cells to a tissue images and alter cellular positions. We also show that augmenting limited real data with the synthetic data generated by our framework can significantly boost prediction performance of the cellular composition prediction task. The implementation of the proposed SynCLay framework is available at https://github.com/Srijay/SynCLay-Framework.

Synthesis of Annotated Colorectal Cancer Tissue Images from Gland Layout

SynCLay: Interactive synthesis of histology images from bespoke cellular layouts

SAFRON: Stitching Across the Frontier for Generating Colorectal Cancer Histology Images

SAFRON: Stitching Across the Frontier Network for Generating Colorectal Cancer Histology Images

Deepfake histological images for enhancing digital pathology

Could We Generate Cytology Images from Histopathology Images? An Empirical Study

Structural Cycle GAN for Virtual Immunohistochemistry Staining of Gland Markers in the Colon

Joint one-sided synthetic unpaired image translation and segmentation for colorectal cancer prevention

Unsupervised Histopathology Image Synthesis

Multiple Morphological Constraints-Based Complex Gland Segmentation in Colorectal Cancer Pathology Image Analysis

Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedback

Synthetic Generation of Three-Dimensional Cancer Cell Models from Histopathological Images

Guided image generation for improved surgical image segmentation

Gland segmentation in colon histology images: The glas challenge contest

GAN-Based Synthetic Gastrointestinal Image Generation

LN-Gen: Rectal Lymph Nodes Generation via Anatomical Features

Synthetic Genitourinary Image Synthesis via Generative Adversarial Networks: Enhancing AI Diagnostic Precision

Synthetic Genitourinary Image Synthesis via Generative Adversarial Networks: Enhancing Artificial Intelligence Diagnostic Precision

MedSyn: Text-guided Anatomy-aware Synthesis of High-Fidelity 3D CT Images

Synthetic Histology Images for Training AI Models: A Novel Approach to Improve Prostate Cancer Diagnosis

Co-synthesis of Histopathology Nuclei Image-Label Pairs using a Context-Conditioned Joint Diffusion Model