A quantitative study of the response of neuroglial cells of the albino rat to portocaval anastomosis and to associated procedures.

W. E. Watson

Journal of Physiology

Abstract:

What problem does this paper attempt to address?

A Resource-Efficient Deep Learning Framework for Low-Dose Brain PET Image Reconstruction and Analysis

Yu Fu,Shunjie Dong,Yi Liu,Xue Li,Yuanfan Xu,Feng Li,Qian Yang,Tianbai Yu,Ming Tian,Cheng Zhuo

DOI: https://doi.org/10.48550/arxiv.2202.06548

2022-01-01

Abstract:18F-fluorodeoxyglucose (18F-FDG) Positron Emission Tomography (PET) imaging usually needs a full-dose radioactive tracer to obtain satisfactory diagnostic results, which raises concerns about the potential health risks of radiation exposure, especially for pediatric patients. Reconstructing the low-dose PET (L-PET) images to the high-quality full-dose PET (F-PET) ones is an effective way that both reduces the radiation exposure and remains diagnostic accuracy. In this paper, we propose a resource-efficient deep learning framework for L-PET reconstruction and analysis, referred to as transGAN-SDAM, to generate F-PET from corresponding L-PET, and quantify the standard uptake value ratios (SUVRs) of these generated F-PET at whole brain. The transGAN-SDAM consists of two modules: a transformer-encoded Generative Adversarial Network (transGAN) and a Spatial Deformable Aggregation Module (SDAM). The transGAN generates higher quality F-PET images, and then the SDAM integrates the spatial information of a sequence of generated F-PET slices to synthesize whole-brain F-PET images. Experimental results demonstrate the superiority and rationality of our approach.
Cross-Modality Generation of Amyloid PET from FDG PET for Alzheimer’s Disease Diagnosis

Yu Fu,Le Xue,Yi Liao,Lin Chen,Meng Niu,Hong Zhang,Mei Tian,Cheng Zhuo

DOI: https://doi.org/10.1109/bibm52615.2021.9669287

2021-01-01

Abstract:Positron Emission Tomography (PET) has been widely used in the early diagnosis and treatment monitoring of Alzheimer’s Disease (AD). As two radiotracers of neurodegeneration, [18F]Fluorodeoxyglucose ([18F]FDG) and [18F]Florbetapir ([18F]AV45) PET have been used to measure cerebral glucose metabolism and $\beta$-amyloid $(A\beta)$ deposition, respectively. The combination of different modality PET images, such as FDG PET and AV45 PET, can provide complementary information for clinical diagnosis and evaluation. However, compared to the actual and available FDG PET data, AV45 PET data is always deficient due to the institution-specific tracers. In this paper, we propose a lightweight Generative Adversarial Network (GAN)-based model, which is termed “dual perceptual loss based generative adversarial network (DPGAN) for fast 2. 5D-based cross-modality generation of AV45 PET from FDG PET. This model provides a potential supplementary solution to those clinical situations that only the FDG PET image is acquired, but the AV45 PET is missing. Our experimental results showed that the DPGAN outperformed recent CycleGAN and pGAN, given its stronger ability in capturing the $A \beta$ deposition patterns on the whole-brain scale. All qualitative and quantitative metrics demonstrated the strong similarity between the generated AV45 PET images using DPGAN and the original AV45 PET images.
Cross-Modality Image Translation From Brain 18 F-FDG PET/CT Images to Fluid-Attenuated Inversion Recovery Images Using the CypixGAN Framework

Sangwon Lee,Jin Ho Jung,Yong Choi,Eunyeong Seok,Jiwoong Jung,Hyunkeong Lim,Dongwoo Kim,Mijin Yun

DOI: https://doi.org/10.1097/RLU.0000000000005441

2024-11-01

Abstract:Purpose: PET/CT and MRI can accurately diagnose dementia but are expensive and inconvenient for patients. Therefore, we aimed to generate synthetic fluid-attenuated inversion recovery (FLAIR) images from 18 F-FDG PET and CT images of the human brain using a generative adversarial network (GAN)-based deep learning framework called the CypixGAN, which combined the CycleGAN framework with the L1 loss function of the pix2pix. Patients and methods: Data from 143 patients who underwent PET/CT and MRI were used for training (n = 79), validation (n = 20), and testing (n = 44) the deep learning frameworks. Synthetic FLAIR images were generated using the pix2pix, CycleGAN, and CypixGAN, and white matter hyperintensities (WMHs) were then segmented. The performance of CypixGAN was compared with that of the other frameworks. Results: The CypixGAN outperformed the pix2pix and CycleGAN in generating synthetic FLAIR images with superior visual quality. Peak signal-to-noise ratio and structural similarity index (mean ± standard deviation) estimated using the CypixGAN (20.23 ± 1.31 and 0.80 ± 0.02, respectively) were significantly higher than those estimated using the pix2pix (19.35 ± 1.43 and 0.79 ± 0.02, respectively) and CycleGAN (18.74 ± 1.49 and 0.78 ± 0.02, respectively) ( P < 0.001). WMHs in synthetic FLAIR images generated using the CypixGAN closely resembled those in ground-truth images, as indicated by the low absolute percentage volume differences and high dice similarity coefficients. Conclusions: The CypixGAN generated high-quality FLAIR images owing to the preservation of spatial information despite using unpaired images. This framework may help improve diagnostic performance and cost-effectiveness of PET/CT when MRI scan is unavailable.
Synthesizing PET/MR (T1-weighted) images from non-attenuation-corrected PET images

Changhui Jiang,Xu Zhang,Na Zhang,Qiyang Zhang,Chao Zhou,Jianmin Yuan,Qiang He,Yongfeng Yang,Xin Liu,Hairong Zheng,Wei Fan,Zhanli Hu,Dong Liang

DOI: https://doi.org/10.1088/1361-6560/ac08b2

IF: 3.5

2021-06-24

Physics in Medicine and Biology

Abstract:Positron emission tomography (PET) imaging can be used for early detection, diagnosis and postoperative patient monitoring of many diseases. Traditional PET imaging requires not only additional computed tomography (CT) imaging or magnetic resonance imaging (MR) to provide anatomical information but also attenuation correction (AC) map calculation based on CT images or MR images for accurate quantitative estimation. During a patient's treatment, PET/CT or PET/MR scans are inevitably repeated many times, leading to additional doses of ionizing radiation (CT scans) and additional economic and time costs (MR scans). To reduce adverse effects while obtaining high-quality PET/MR images in the course of a patient's treatment, especially in the stage of evaluating the effect of postoperative treatment, in this work, we propose a new method based on deep learning, which can directly obtain synthetic attenuation-corrected PET (sAC PET) and synthetic T1-weighted MR (sMR) images based only on non-attenuation-corrected PET (NAC PET) images. Our model, based on the Wasserstein generative adversarial network, first removes noise and artifacts from the NAC PET images to generate sAC PET images and then generates sMR images from the obtained sAC PET images. To evaluate the performance of this generative model, we evaluated it on paired PET/MR images from a total of eighty clinical patients. Based on qualitative and quantitative analysis, the generated sAC PET and sMR images showed a high degree of similarity to the real AC PET and real MR images. These results indicated that our proposed method can reduce the frequency of additional anatomical imaging scans during PET imaging and has great potential in improving doctors' clinical diagnosis efficiency, saving patients' economic expenditure and reducing the radiation risk brought by CT scanning.

engineering, biomedical,radiology, nuclear medicine & medical imaging
Synthesizing PET images from high‐field and ultra‐high‐field MR images using joint diffusion attention model

Taofeng Xie,Chentao Cao,Zhuo‐xu Cui,Yu Guo,Caiying Wu,Xuemei Wang,Qingneng Li,Zhanli Hu,Tao Sun,Ziru Sang,Yihang Zhou,Yanjie Zhu,Dong Liang,Qiyu Jin,Hongwu Zeng,Guoqing Chen,Haifeng Wang

DOI: https://doi.org/10.1002/mp.17254

IF: 4.506

2024-06-16

Medical Physics

Abstract:Background Magnetic Resonance Imaging (MRI) and Positron Emission Tomography (PET) stand as pivotal diagnostic tools for brain disorders, offering the potential for mutually enriching disease diagnostic perspectives. However, the costs associated with PET scans and the inherent radioactivity have limited the widespread application of PET. Furthermore, it is noteworthy to highlight the promising potential of high‐field and ultra‐high‐field neuroimaging in cognitive neuroscience research and clinical practice. With the enhancement of MRI resolution, a related question arises: can high‐resolution MRI improve the quality of PET images? Purpose This study aims to enhance the quality of synthesized PET images by leveraging the superior resolution capabilities provided by high‐field and ultra‐high‐field MRI. Methods From a statistical perspective, the joint probability distribution is considered the most direct and fundamental approach for representing the correlation between PET and MRI. In this study, we proposed a novel model, the joint diffusion attention model, namely, the joint diffusion attention model (JDAM), which primarily focuses on learning information about the joint probability distribution. JDAM consists of two primary processes: the diffusion process and the sampling process. During the diffusion process, PET gradually transforms into a Gaussian noise distribution by adding Gaussian noise, while MRI remains fixed. The central objective of the diffusion process is to learn the gradient of the logarithm of the joint probability distribution between MRI and noise PET. The sampling process operates as a predictor‐corrector. The predictor initiates a reverse diffusion process, and the corrector applies Langevin dynamics. Results Experimental results from the publicly available Alzheimer's Disease Neuroimaging Initiative dataset highlight the effectiveness of the proposed model compared to state‐of‐the‐art (SOTA) models such as Pix2pix and CycleGAN. Significantly, synthetic PET images guided by ultra‐high‐field MRI exhibit marked improvements in signal‐to‐noise characteristics when contrasted with those generated from high‐field MRI data. These results have been endorsed by medical experts, who consider the PET images synthesized through JDAM to possess scientific merit. This endorsement is based on their symmetrical features and precise representation of regions displaying hypometabolism, a hallmark of Alzheimer's disease. Conclusions This study establishes the feasibility of generating PET images from MRI. Synthesis of PET by JDAM significantly enhances image quality compared to SOTA models.

radiology, nuclear medicine & medical imaging
Ultra-low-dose PET reconstruction using generative adversarial network with feature matching and task-specific perceptual loss

Jiahong Ouyang,Kevin T Chen,Enhao Gong,John Pauly,Greg Zaharchuk

DOI: https://doi.org/10.1002/mp.13626

Abstract:Purpose: Our goal was to use a generative adversarial network (GAN) with feature matching and task-specific perceptual loss to synthesize standard-dose amyloid Positron emission tomography (PET) images of high quality and including accurate pathological features from ultra-low-dose PET images only. Methods: Forty PET datasets from 39 participants were acquired with a simultaneous PET/MRI scanner following injection of 330 ± 30 MBq of the amyloid radiotracer 18F-florbetaben. The raw list-mode PET data were reconstructed as the standard-dose ground truth and were randomly undersampled by a factor of 100 to reconstruct 1% low-dose PET scans. A 2D encoder-decoder network was implemented as the generator to synthesize a standard-dose image and a discriminator was used to evaluate them. The two networks contested with each other to achieve high-visual quality PET from the ultra-low-dose PET. Multi-slice inputs were used to reduce noise by providing the network with 2.5D information. Feature matching was applied to reduce hallucinated structures. Task-specific perceptual loss was designed to maintain the correct pathological features. The image quality was evaluated by peak signal-to-noise ratio (PSNR), structural similarity (SSIM), and root mean square error (RMSE) metrics with and without each of these modules. Two expert radiologists were asked to score image quality on a 5-point scale and identified the amyloid status (positive or negative). Results: With only low-dose PET as input, the proposed method significantly outperformed Chen et al.'s method (Chen et al. Radiology. 2018;290:649-656) (which shows the best performance in this task) with the same input (PET-only model) by 1.87 dB in PSNR, 2.04% in SSIM, and 24.75% in RMSE. It also achieved comparable results to Chen et al.'s method which used additional magnetic resonance imaging (MRI) inputs (PET-MR model). Experts' reading results showed that the proposed method could achieve better overall image quality and maintain better pathological features indicating amyloid status than both PET-only and PET-MR models proposed by Chen et al. CONCLUSION: Standard-dose amyloid PET images can be synthesized from ultra-low-dose images using GAN. Applying adversarial learning, feature matching, and task-specific perceptual loss are essential to ensure image quality and the preservation of pathological features.
Multi-Subject Image Synthesis as a Generative Prior for Single-Subject PET Image Reconstruction

George Webber,Yuya Mizuno,Oliver D. Howes,Alexander Hammers,Andrew P. King,Andrew J. Reader

DOI: https://doi.org/10.1109/NSS/MIC/RTSD57108.2024.10657446

2024-12-06

Abstract:Large high-quality medical image datasets are difficult to acquire but necessary for many deep learning applications. For positron emission tomography (PET), reconstructed image quality is limited by inherent Poisson noise. We propose a novel method for synthesising diverse and realistic pseudo-PET images with improved signal-to-noise ratio. We also show how our pseudo-PET images may be exploited as a generative prior for single-subject PET image reconstruction. Firstly, we perform deep-learned deformable registration of multi-subject magnetic resonance (MR) images paired to multi-subject PET images. We then use the anatomically-learned deformation fields to transform multiple PET images to the same reference space, before averaging random subsets of the transformed multi-subject data to form a large number of varying pseudo-PET images. We observe that using MR information for registration imbues the resulting pseudo-PET images with improved anatomical detail compared to the originals. We consider applications to PET image reconstruction, by generating pseudo-PET images in the same space as the intended single-subject reconstruction and using them as training data for a diffusion model-based reconstruction method. We show visual improvement and reduced background noise in our 2D reconstructions as compared to OSEM, MAP-EM and an existing state-of-the-art diffusion model-based approach. Our method shows the potential for utilising highly subject-specific prior information within a generative reconstruction framework. Future work may compare the benefits of our approach to explicitly MR-guided reconstruction methodologies.

Medical Physics,Computer Vision and Pattern Recognition
The surface chemistry of bone. VI. Recrystallization in vivo.

W. Neuman,B. J. Mulryan

IF: 5.485

1952-04-01

Journal of Biological Chemistry

Abstract:
Synthesizing PET images from High-field and Ultra-high-field MR images Using Joint Diffusion Attention Model

Taofeng Xie,Chentao Cao,Zhuoxu Cui,Yu Guo,Caiying Wu,Xuemei Wang,Qingneng Li,Zhanli Hu,Tao Sun,Ziru Sang,Yihang Zhou,Yanjie Zhu,Dong Liang,Qiyu Jin,Hongwu Zeng,Guoqing Chen,Haifeng Wang

2024-06-19

Abstract:MRI and PET are crucial diagnostic tools for brain diseases, as they provide complementary information on brain structure and function. However, PET scanning is costly and involves radioactive exposure, resulting in a lack of PET. Moreover, simultaneous PET and MRI at ultra-high-field are currently hardly infeasible. Ultra-high-field imaging has unquestionably proven valuable in both clinical and academic settings, especially in the field of cognitive neuroimaging. These motivate us to propose a method for synthetic PET from high-filed MRI and ultra-high-field MRI. From a statistical perspective, the joint probability distribution (JPD) is the most direct and fundamental means of portraying the correlation between PET and MRI. This paper proposes a novel joint diffusion attention model which has the joint probability distribution and attention strategy, named JDAM. JDAM has a diffusion process and a sampling process. The diffusion process involves the gradual diffusion of PET to Gaussian noise by adding Gaussian noise, while MRI remains fixed. JPD of MRI and noise-added PET was learned in the diffusion process. The sampling process is a predictor-corrector. PET images were generated from MRI by JPD of MRI and noise-added PET. The predictor is a reverse diffusion process and the corrector is Langevin dynamics. Experimental results on the public Alzheimer's Disease Neuroimaging Initiative (ADNI) dataset demonstrate that the proposed method outperforms state-of-the-art CycleGAN for high-field MRI (3T MRI). Finally, synthetic PET images from the ultra-high-field (5T MRI and 7T MRI) be attempted, providing a possibility for ultra-high-field PET-MRI imaging.

Machine Learning
Delayed PET Imaging Using Image Synthesis Network and Nonrigid Registration Without Additional CT Scan.

Fan Rao,Zhuoxuan Wu,Lu Han,Bao Yang,Weidong Han,Wentao Zhu

DOI: https://doi.org/10.1002/mp.15574

IF: 4.506

2022-01-01

Medical Physics

Abstract:PURPOSEAttenuation correction is critical for positron emission tomography (PET) image reconstruction. The standard protocol for obtaining attenuation information in a clinical PET scanner is via the coregistered computed tomography (CT) images. Therefore for delayed PET imaging, the CT scan is repeated twice, which increases the radiation dose for the patient. In this paper, we propose a zero-extra-dose delayed PET imaging method which requires no additional CT scans.METHODSA deep learning based synthesis network is designed to convert the PET data into a pseudo CT image for the delayed scan. Then, nonrigid registration is performed between this pseudo CT image and the CT image of the first scan, warping the CT image of the first scan to an estimated CT images for the delayed scan. Finally, the PET image attenuation correction in the delayed scan is obtained from this estimated CT image. Experiments with clinical datasets are implemented to assess the effectiveness of the proposed method with the well-recognized GAN method. The average peak signal-to-noise ratio (PSNR) and the mean absolute percent error (MAPE) are used in comparison. We also use scoring from three experienced radiologists as subjective measurement means, based on the diagnostic consistency of the PET images reconstructed from GAN and the proposed method with respect to the ground truth images.RESULTSThe experiments show that the average PSNR is 47.04 dB (the proposed method) v.s. 44.41 dB (the traditional GAN method) for the reconstructed delayed PET images in our evaluation dataset. The average MAPEs are 1.59% for the proposed method and 3.32% for the traditional GAN method across five organ Regions of Interest (ROIs). The scores for the GAN and the proposed method rated by three experienced radiologists are 8.08±0.60 and 9.02±0.52, indicating that the proposed method yields more consistent PET images with the ground truth.CONCLUSIONSThis work proposes a novel method for CT-less delayed PET imaging based on image synthesis network and nonrigid image registration. The PET image reconstructed using the proposed method yields delayed PET images with high image quality without artifacts, and is quantitatively more accurate compared with the traditional GAN method. This article is protected by copyright. All rights reserved.
Pixel-Feature Hybrid Fusion for PET/CT Images

Yang-Ming Zhu,Charles A. Nortmann

DOI: https://doi.org/10.1007/s10278-009-9259-8

IF: 4.903

2010-01-01

Journal of Digital Imaging

Abstract:Color blending is a popular display method for functional and anatomic image fusion. The underlay image is typically displayed in grayscale, and the overlay image is displayed in pseudo colors. This pixel-level fusion provides too much information for reviewers to analyze quickly and effectively and clutters the display. To improve the fusion image reviewing speed and reduce the information clutter, a pixel-feature hybrid fusion method is proposed and tested for PET/CT images. Segments of the colormap are selectively masked to have a few discrete colors, and pixels displayed in the masked colors are made transparent. The colormap thus creates a false contouring effect on overlay images and allows the underlay to show through to give contours an anatomic context. The PET standardized uptake value (SUV) is used to control where colormap segments are masked. Examples show that SUV features can be extracted and blended with CT image instantaneously for viewing and diagnosis, and the non-feature part of the PET image is transparent. The proposed pixel-feature hybrid fusion highlights PET SUV features on CT images and reduces display clutters. It is easy to implement and can be used as complementarily to existing pixel-level fusion methods.
Augmented deep learning model for improved quantitative accuracy of MR-based PET attenuation correction in PSMA PET-MRI prostate imaging

Andrii Pozaruk,Kamlesh Pawar,Shenpeng Li,Alexandra Carey,Jeremy Cheng,Viswanath P. Sudarshan,Marian Cholewa,Jeremy Grummet,Zhaolin Chen,Gary Egan

DOI: https://doi.org/10.1007/s00259-020-04816-9

2020-05-11

Abstract:PurposeEstimation of accurate attenuation maps for whole-body positron emission tomography (PET) imaging in simultaneous PET-MRI systems is a challenging problem as it affects the quantitative nature of the modality. In this study, we aimed to improve the accuracy of estimated attenuation maps from MRI Dixon contrast images by training an augmented generative adversarial network (GANs) in a supervised manner. We augmented the GANs by perturbing the non-linear deformation field during image registration between MRI and the ground truth CT images.MethodsWe acquired the CT and the corresponding PET-MR images for a cohort of 28 prostate cancer patients. Data from 18 patients (2160 slices and later augmented to 270,000 slices) was used for training the GANs and others for validation. We calculated the error in bone and soft tissue regions for the AC μ-maps and the reconstructed PET images.ResultsFor quantitative analysis, we use the average relative absolute errors and validate the proposed technique on 10 patients. The DL-based MR methods generated the pseudo-CT AC μ-maps with an accuracy of 4.5% more than standard MR-based techniques. Particularly, the proposed method demonstrates improved accuracy in the pelvic regions without affecting the uptake values. The lowest error of the AC μ-map in the pelvic region was 1.9% for μ-mapGAN + aug compared with 6.4% for μ-mapdixon, 5.9% for μ-mapdixon + bone, 2.1% for μ-mapU-Net and 2.0% for μ-mapU-Net + aug. For the reconstructed PET images, the lowest error was 2.2% for PETGAN + aug compared with 10.3% for PETdixon, 8.7% for PETdixon + bone, 2.6% for PETU-Net and 2.4% for PETU-Net + aug..ConclusionThe proposed technique to augment the training datasets for training of the GAN results in improved accuracy of the estimated μ-map and consequently the PET quantification compared to the state of the art.

radiology, nuclear medicine & medical imaging
[Indications and surgical therapy of thyroid gland diseases--analysis of 725 operated patients].

M. Steinert,T. Friedrich,R. Keitel,B. Sattler,M. Schönfelder

Zentralblatt für Chirurgie

Abstract:Diseases of the thyroid gland are an important part of elective surgical procedures. The adequate surgical therapy is at present standardized and requires a permanent qualitative control to reduce avoidable complications. The relation between men and women in our patients (n = 725) was 1 to 5. The mean age was 51.2 years. 10% (n = 79) of the patients were hyperthyroid. 646 patients had benign disease; and 79 patients were found to have malignancy of the thyroid gland. The most common indication for an operation was bilateral multinodular goitre (n = 325) in combination with a cold nodule (n = 123), in 79 patients latent hyperthyroidism or Morbus Basedow (n = 22). Struma nodosa with retrosternal extension (n = 49), recurrence of goitre (n = 34), thyroiditis (n = 12) and dystopic goitre (n = 2) were rare in these patients. Patients with malignancy of the thyroid gland were always treated by thyroidectomy or completed thyroidectomy with lymphnode dissection. In the cases of benign disease the surgical methods were variable, although the bilateral subtotal resection (n = 413) predominated. While doing so the radical resection of parenchyma with a persistent functioning remnant of goitre of 5 cm3 was favoured. The resulting postoperative complications are discussed. An endocrinological appropriate follow-up of the patients is necessary.
Nimg-65. Synthetic Mri Generation To Facilitate Autosegmentation Of Pediatric Brain Tumors In Limited Data Scenarios

Dimosthenis Chrysochoou,Deep Gandhi,Ariana Familiar,Arastoo Vossough,Phillip Storm,Adam Resnick,Christos Davatzikos,Ali Nabavizadeh,Anahita Fathi Kazerooni

DOI: https://doi.org/10.1093/neuonc/noae165.0829

2024-11-29

Neuro-Oncology

Abstract:BACKGROUNDThe availability of standard multiparametric MRI sequences, including pre-contrast T1w (T1w-pre), post-contrast T1w (T1w-post), T2w, and FLAIR images, is essential for accurate segmentation of tumor subregions and subsequent response assessment in pediatric brain tumors (PBTs). However, clinical MRI sets are often incomplete due to imaging artifacts or inconsistent acquisition protocols across different centers. This study leverages Generative Adversarial Networks (GANs) to synthesize missing FLAIR and T1w-pre images from T2w and T1w-post images, respectively, to facilitate tumor segmentation in PBTs. METHODSWe developed two GAN models based on the pix2pix framework, trained, validated, and tested on FLAIR-T2w and T1w-post-T1w-pre pairs from a multi-histology and multi-institutional cohort of 476 subjects with PBTs from the Children's Brain Tumor Network (CBTN). The perceptual quality of the synthesized T1w-pre and FLAIR images was evaluated using the Structural Similarity Index (SSI; ideal value = 1). The robustness of the synthesized sequences to replace missing MRI sequences was evaluated by comparing the segmentation performance (Dice score) of our pre-trained autosegmentation model using all real modalities versus replacing real sequences with their synthesized counterparts. RESULTSThe T1w-pre and FLAIR synthesis GANs achieved mean SSI values of 0.95 and 0.93, respectively. Median Dice scores for segmentation of whole tumor (WT), enhancing tumor (ET), and tumor core (TC) were calculated for real sequences: 0.90, 0.83, 0.89, replacing real FLAIR with synthetic: 0.86, 0.81, 0.86, and replacing real T1w-pre with synthetic: 0.90, 0.75, 0.89. No statistical significance (p>0.05) was observed in segmentation performance for WT, TC, ET when replacing real T1w-pre with synthetic, and for ET when replacing real with synthetic FLAIR sequences. CONCLUSIONThis method achieves robust segmentation performance in limited data scenarios by synthesizing missing MRI sequences. Future work includes improving FLAIR synthesis and segmentation performance for WT and ET by implementing and comparing other GAN architectures.

oncology,clinical neurology
MedFusionGAN: multimodal medical image fusion using an unsupervised deep generative adversarial network

Mojtaba Safari,Ali Fatemi,Louis Archambault

DOI: https://doi.org/10.1186/s12880-023-01160-w

IF: 2.7949

2023-12-07

BMC Medical Imaging

Abstract:Abstract Purpose This study proposed an end-to-end unsupervised medical fusion generative adversarial network, MedFusionGAN, to fuse computed tomography (CT) and high-resolution isotropic 3D T1-Gd Magnetic resonance imaging (MRI) image sequences to generate an image with CT bone structure and MRI soft tissue contrast to improve target delineation and to reduce the radiotherapy planning time. Methods We used a publicly available multicenter medical dataset (GLIS-RT, 230 patients) from the Cancer Imaging Archive. To improve the models generalization, we consider different imaging protocols and patients with various brain tumor types, including metastases. The proposed MedFusionGAN consisted of one generator network and one discriminator network trained in an adversarial scenario. Content, style, and L1 losses were used for training the generator to preserve the texture and structure information of the MRI and CT images. Results The MedFusionGAN successfully generates fused images with MRI soft-tissue and CT bone contrast. The results of the MedFusionGAN were quantitatively and qualitatively compared with seven traditional and eight deep learning (DL) state-of-the-art methods. Qualitatively, our method fused the source images with the highest spatial resolution without adding the image artifacts. We reported nine quantitative metrics to quantify the preservation of structural similarity, contrast, distortion level, and image edges in fused images. Our method outperformed both traditional and DL methods on six out of nine metrics. And it got the second performance rank for three and two quantitative metrics when compared with traditional and DL methods, respectively. To compare soft-tissue contrast, intensity profile along tumor and tumor contours of the fusion methods were evaluated. MedFusionGAN provides a more consistent, better intensity profile, and a better segmentation performance. Conclusions The proposed end-to-end unsupervised method successfully fused MRI and CT images. The fused image could improve targets and OARs delineation, which is an important aspect of radiotherapy treatment planning.

radiology, nuclear medicine & medical imaging
3-D PET Image Generation with tumour masks using TGAN

Robert V Bergen,Jean-Francois Rajotte,Fereshteh Yousefirizi,Ivan S Klyuzhin,Arman Rahmim,Raymond T. Ng

DOI: https://doi.org/10.48550/arXiv.2111.01866

2021-11-03

Abstract:Training computer-vision related algorithms on medical images for disease diagnosis or image segmentation is difficult due to the lack of training data, labeled samples, and privacy concerns. For this reason, a robust generative method to create synthetic data is highly sought after. However, most three-dimensional image generators require additional image input or are extremely memory intensive. To address these issues we propose adapting video generation techniques for 3-D image generation. Using the temporal GAN (TGAN) architecture, we show we are able to generate realistic head and neck PET images. We also show that by conditioning the generator on tumour masks, we are able to control the geometry and location of the tumour in the generated images. To test the utility of the synthetic images, we train a segmentation model using the synthetic images. Synthetic images conditioned on real tumour masks are automatically segmented, and the corresponding real images are also segmented. We evaluate the segmentations using the Dice score and find the segmentation algorithm performs similarly on both datasets (0.65 synthetic data, 0.70 real data). Various radionomic features are then calculated over the segmented tumour volumes for each data set. A comparison of the real and synthetic feature distributions show that seven of eight feature distributions had statistically insignificant differences (p>0.05). Correlation coefficients were also calculated between all radionomic features and it is shown that all of the strong statistical correlations in the real data set are preserved in the synthetic data set.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning,Medical Physics
Paired Diffusion: Generation of related, synthetic PET-CT-Segmentation scans using Linked Denoising Diffusion Probabilistic Models

Rowan Bradbury,Katherine A. Vallis,Bartlomiej W. Papiez

2024-03-26

Abstract:The rapid advancement of Artificial Intelligence (AI) in biomedical imaging and radiotherapy is hindered by the limited availability of large imaging data repositories. With recent research and improvements in denoising diffusion probabilistic models (DDPM), high quality synthetic medical scans are now possible. Despite this, there is currently no way of generating multiple related images, such as a corresponding ground truth which can be used to train models, so synthetic scans are often manually annotated before use. This research introduces a novel architecture that is able to generate multiple, related PET-CT-tumour mask pairs using paired networks and conditional encoders. Our approach includes innovative, time step-controlled mechanisms and a `noise-seeding' strategy to improve DDPM sampling consistency. While our model requires a modified perceptual loss function to ensure accurate feature alignment we show generation of clearly aligned synthetic images and improvement in segmentation accuracy with generated images.

Image and Video Processing,Computer Vision and Pattern Recognition
[Bacterial and clinical studies of disinfectants for self-catheterization].

A. Esa,M. Ikegami,T. Sugiyama,Y. Park,T. Kurita,S. Kaneko,M. Iimori

DOI: https://doi.org/10.5980/jpnjurol1928.79.10_1663

Abstract:Atsunobu Esa, Masahisa Ikegami, Takahide Sugiyama, Young-Chol Park and Takashi Kurita Department of Urology, Kinki University School of Medicine, Osaka, Japan (Director: Prof. T. Kurita) Shigeo Kaneko Department of Urology, Asahikawa Medical College, Hokkaido, Japan (Director: Prof. S. Yachiku) Masaki Iimori Department of Central Clinical Laboratory, Kinki University School of Medicine, Osaka, Japan (Director: Prof. Y. Ooba)
Synthetic PET from CT improves diagnosis and prognosis for lung cancer: Proof of concept

Morteza Salehjahromi,Tatiana V Karpinets,Sheeba J Sujit,Mohamed Qayati,Pingjun Chen,Muhammad Aminu,Maliazurina B Saad,Rukhmini Bandyopadhyay,Lingzhi Hong,Ajay Sheshadri,Julie Lin,Mara B Antonoff,Boris Sepesi,Edwin J Ostrin,Iakovos Toumazis,Peng Huang,Chao Cheng,Tina Cascone,Natalie I Vokes,Carmen Behrens,Jeffrey H Siewerdsen,John D Hazle,Joe Y Chang,Jianhua Zhang,Yang Lu,Myrna C B Godoy,Caroline Chung,David Jaffray,Ignacio Wistuba,J Jack Lee,Ara A Vaporciyan,Don L Gibbons,Gregory Gladish,John V Heymach,Carol C Wu,Jianjun Zhang,Jia Wu

DOI: https://doi.org/10.1016/j.xcrm.2024.101463

2024-03-19

Abstract:[18F]Fluorodeoxyglucose positron emission tomography (FDG-PET) and computed tomography (CT) are indispensable components in modern medicine. Although PET can provide additional diagnostic value, it is costly and not universally accessible, particularly in low-income countries. To bridge this gap, we have developed a conditional generative adversarial network pipeline that can produce FDG-PET from diagnostic CT scans based on multi-center multi-modal lung cancer datasets (n = 1,478). Synthetic PET images are validated across imaging, biological, and clinical aspects. Radiologists confirm comparable imaging quality and tumor contrast between synthetic and actual PET scans. Radiogenomics analysis further proves that the dysregulated cancer hallmark pathways of synthetic PET are consistent with actual PET. We also demonstrate the clinical values of synthetic PET in improving lung cancer diagnosis, staging, risk prediction, and prognosis. Taken together, this proof-of-concept study testifies to the feasibility of applying deep learning to obtain high-fidelity PET translated from CT.
Synthetic PET via Domain Translation of 3D MRI

Abhejit Rajagopal,Yutaka Natsuaki,Kristen Wangerin,Mahdjoub Hamdi,Hongyu An,John J. Sunderland,Richard Laforest,Paul E. Kinahan,Peder E.Z. Larson,Thomas A.Hope

DOI: https://doi.org/10.48550/arXiv.2206.05618

IF: 4.506

2022-06-11

Medical Physics

Abstract:Historically, patient datasets have been used to develop and validate various reconstruction algorithms for PET/MRI and PET/CT. To enable such algorithm development, without the need for acquiring hundreds of patient exams, in this paper we demonstrate a deep learning technique to generate synthetic but realistic whole-body PET sinograms from abundantly-available whole-body MRI. Specifically, we use a dataset of 56 $^{18}$F-FDG-PET/MRI exams to train a 3D residual UNet to predict physiologic PET uptake from whole-body T1-weighted MRI. In training we implemented a balanced loss function to generate realistic uptake across a large dynamic range and computed losses along tomographic lines of response to mimic the PET acquisition. The predicted PET images are forward projected to produce synthetic PET time-of-flight (ToF) sinograms that can be used with vendor-provided PET reconstruction algorithms, including using CT-based attenuation correction (CTAC) and MR-based attenuation correction (MRAC). The resulting synthetic data recapitulates physiologic $^{18}$F-FDG uptake, e.g. high uptake localized to the brain and bladder, as well as uptake in liver, kidneys, heart and muscle. To simulate abnormalities with high uptake, we also insert synthetic lesions. We demonstrate that this synthetic PET data can be used interchangeably with real PET data for the PET quantification task of comparing CT and MR-based attenuation correction methods, achieving $\leq 7.6\%$ error in mean-SUV compared to using real data. These results together show that the proposed synthetic PET data pipeline can be reasonably used for development, evaluation, and validation of PET/MRI reconstruction methods.

A quantitative study of the response of neuroglial cells of the albino rat to portocaval anastomosis and to associated procedures.

A Resource-Efficient Deep Learning Framework for Low-Dose Brain PET Image Reconstruction and Analysis

Cross-Modality Generation of Amyloid PET from FDG PET for Alzheimer’s Disease Diagnosis

Cross-Modality Image Translation From Brain 18 F-FDG PET/CT Images to Fluid-Attenuated Inversion Recovery Images Using the CypixGAN Framework

Synthesizing PET/MR (T1-weighted) images from non-attenuation-corrected PET images

Synthesizing PET images from high‐field and ultra‐high‐field MR images using joint diffusion attention model

Ultra-low-dose PET reconstruction using generative adversarial network with feature matching and task-specific perceptual loss

Multi-Subject Image Synthesis as a Generative Prior for Single-Subject PET Image Reconstruction

The surface chemistry of bone. VI. Recrystallization in vivo.

Synthesizing PET images from High-field and Ultra-high-field MR images Using Joint Diffusion Attention Model

Delayed PET Imaging Using Image Synthesis Network and Nonrigid Registration Without Additional CT Scan.

Pixel-Feature Hybrid Fusion for PET/CT Images

Augmented deep learning model for improved quantitative accuracy of MR-based PET attenuation correction in PSMA PET-MRI prostate imaging

[Indications and surgical therapy of thyroid gland diseases--analysis of 725 operated patients].

Nimg-65. Synthetic Mri Generation To Facilitate Autosegmentation Of Pediatric Brain Tumors In Limited Data Scenarios

MedFusionGAN: multimodal medical image fusion using an unsupervised deep generative adversarial network

3-D PET Image Generation with tumour masks using TGAN

Paired Diffusion: Generation of related, synthetic PET-CT-Segmentation scans using Linked Denoising Diffusion Probabilistic Models

[Bacterial and clinical studies of disinfectants for self-catheterization].

Synthetic PET from CT improves diagnosis and prognosis for lung cancer: Proof of concept

Synthetic PET via Domain Translation of 3D MRI