Abstract:Significant diagnostic variability between and within observers persists in pathology, despite the fact that digital slide images provide the ability to measure and quantify features much more precisely compared to conventional methods. Automated and accurate segmentation of cancerous cell and tissue regions can streamline the diagnostic process, providing insights into the cancer progression, and helping experts decide on the most effective treatment. Here, we evaluate the performance of the proposed PathoSeg model, with an architecture comprising of a modified HRNet encoder and a UNet++ decoder integrated with a CBAM block to utilize attention mechanism for an improved segmentation capability. We demonstrate that PathoSeg outperforms the current state-of-the-art (SOTA) networks in both quantitative and qualitative assessment of instance and semantic segmentation. Notably, we leverage the use of synthetic data generated by PathopixGAN, which effectively addresses the data imbalance problem commonly encountered in histopathology datasets, further improving the performance of PathoSeg. It utilizes spatially adaptive normalization within a generative and discriminative mechanism to synthesize diverse histopathological environments dictated through semantic information passed through pixel-level annotated Ground Truth semantic masks.Besides, we contribute to the research community by providing an in-house dataset that includes semantically segmented masks for breast carcinoma tubules (BCT), micro/macrovesicular steatosis of the liver (MSL), and prostate carcinoma glands (PCG). In the first part of the dataset, we have a total of 14 whole slide images from 13 patients' liver, with fat cell segmented masks, totaling 951 masks of size 512 × 512 pixels. In the second part, it includes 17 whole slide images from 13 patients with prostate carcinoma gland segmentation masks, amounting to 30,000 masks of size 512 × 512 pixels. In the third part, the dataset contains 51 whole slides from 36 patients, with breast carcinoma tubule masks totaling 30,000 masks of size 512 × 512 pixels. To ensure transparency and encourage further research, we will make this dataset publicly available for non-commercial and academic purposes. To facilitate reproducibility and encourage further research, we will also make our code and pre-trained models publicly available at https://github.com/DeepMIALab/PathoSeg.

Pseudo-healthy synthesis with pathology disentanglement and adversarial learning

Adversarial Pseudo Healthy Synthesis Needs Pathology Factorization

Semi-Supervised Pseudo-Healthy Image Synthesis Via Confidence Augmentation

Harmonizing Pathological and Normal Pixels for Pseudo-Healthy Synthesis

Generator Versus Segmentor: Pseudo-healthy Synthesis

Lesion region inpainting: an approach for pseudo-healthy image synthesis in intracranial infection imaging

Where is the disease? Semi-supervised pseudo-normality synthesis from an abnormal image

Medical Image Synthesis via Fine-Grained Image-Text Alignment and Anatomy-Pathology Prompting

An Adversarial Learning Approach to Medical Image Synthesis for Lesion Removal.

Reversing the Abnormal: Pseudo-Healthy Generative Networks for Anomaly Detection

Subject-Specific Lesion Generation and Pseudo-Healthy Synthesis for Multiple Sclerosis Brain Images

Image Synthesis as a Pretext for Unsupervised Histopathological Diagnosis

An Adversarial Learning Approach to Medical Image Synthesis for Lesion Detection

A robust image segmentation and synthesis pipeline for histopathology

Adversarial cycle-consistent synthesis of cerebral microbleeds for data augmentation

PathUp: Patch-wise Timestep Tracking for Multi-class Large Pathology Image Synthesising Diffusion Model

Aligning Synthetic Medical Images with Clinical Knowledge using Human Feedback

What is Healthy? Generative Counterfactual Diffusion for Lesion Localization

Bi-parametric prostate MR image synthesis using pathology and sequence-conditioned stable diffusion

Analysis-synthesis model learning with shared features: A new framework for histopathological image classification

Synthesis of Registered Multimodal Medical Images with Lesions.