Abstract:Objective.Head and neck radiotherapy planning requires electron densities from different tissues for dose calculation. Dose calculation from imaging modalities such as MRI remains an unsolved problem since this imaging modality does not provide information about the density of electrons.Approach.We propose a generative adversarial network (GAN) approach that synthesizes CT (sCT) images from T1-weighted MRI acquisitions in head and neck cancer patients. Our contribution is to exploit new features that are relevant for improving multimodal image synthesis, and thus improving the quality of the generated CT images. More precisely, we propose a Dual branch generator based on the U-Net architecture and on an augmented multi-planar branch. The augmented branch learns specific 3D dynamic features, which describe the dynamic image shape variations and are extracted from different view-points of the volumetric input MRI. The architecture of the proposed model relies on an end-to-end convolutional U-Net embedding network.Results.The proposed model achieves a mean absolute error (MAE) of18.76±5.167in the target Hounsfield unit (HU) space on sagittal head and neck patients, with a mean structural similarity (MSSIM) of0.95±0.09and a Frechet inception distance (FID) of145.60±8.38. The model yields a MAE of26.83±8.27to generate specific primary tumor regions on axial patient acquisitions, with a Dice score of0.73±0.06and a FID distance equal to122.58±7.55. The improvement of our model over other state-of-the-art GAN approaches is of 3.8%, on a tumor test set. On both sagittal and axial acquisitions, the model yields the best peak signal-to-noise ratio of27.89±2.22and26.08±2.95to synthesize MRI from CT input.Significance.The proposed model synthesizes both sagittal and axial CT tumor images, used for radiotherapy treatment planning in head and neck cancer cases. The performance analysis across different imaging metrics and under different evaluation strategies demonstrates the effectiveness of our dual CT synthesis model to produce high quality sCT images compared to other state-of-the-art approaches. Our model could improve clinical tumor analysis, in which a further clinical validation remains to be explored.

CT synthesis from MRI using multi-cycle GAN for head-and-neck radiation therapy

Synthetic CT generation from cone-beam CT using deep-learning for breast adaptive radiotherapy

A Novel Method Of Synthetic Ct Generation From Mr Images Based On Convolutional Neural Networks

Synthesis of pseudo-CT images from pelvic MRI images based on an MD-CycleGAN model for radiotherapy

Channel-wise attention enhanced and structural similarity constrained cycleGAN for effective synthetic CT generation from head and neck MRI images

Synthetic CT generation based on multi-sequence MR using CycleGAN for head and neck MRI-only planning

Multi-planar dual adversarial network based on dynamic 3D features for MRI-CT head and neck image synthesis

Mask-guided generative adversarial network for MRI-based CT synthesis

Enhanced Synthetic MRI Generation from CT Scans Using CycleGAN with Feature Extraction

Generating Synthesized Computed Tomography (CT) from Cone-Beam Computed Tomography (CBCT) using CycleGAN for Adaptive Radiation Therapy

CT synthesis from MR in the pelvic area using Residual Transformer Conditional GAN

CBCT-Based Synthetic MRI Generation for CBCT-Guided Adaptive Radiotherapy.

Synthetic CT generation based on CBCT using respath‐cycleGAN

Imaging Study of Pseudo-CT Synthesized From Cone-Beam CT Based on 3D CycleGAN in Radiotherapy

Synthetic CT generation for pelvic cases based on deep learning in multi-center datasets

MRI-only brain radiotherapy: Assessing the dosimetric accuracy of synthetic CT images generated using a deep learning approach

A Novel Perceptual Constrained cycleGAN With Attention Mechanisms for Unsupervised MR‐to‐CT Synthesis

Leveraging Multimodal CycleGAN for the Generation of Anatomically Accurate Synthetic CT Scans from MRIs

CBCT-to-CT synthesis with a single neural network for head-and-neck, lung and breast cancer adaptive radiotherapy

Cycle-consistent Generative Adversarial Network Synthetic CT for MR-only Adaptive Radiation Therapy on MR-Linac

Channel-Spatial Attention Guided CycleGAN for CBCT-Based Synthetic CT Generation to Enable Adaptive Radiotherapy