Abstract:Purpose Optical surface imaging presents radiation-dose-free and noninvasive approaches for image guided radiation therapy, allowing continuous monitoring during treatment delivery. However, it falls short in cases where correlation of motion between body surface and internal tumor is complex, limiting the use of purely surface guided surrogates for tumor tracking. Relying solely on surface guided radiation therapy (SGRT) may not ensure accurate intrafractional monitoring. This work aims to develop a data-driven framework, mitigating the limitations of SGRT in lung cancer radiation therapy by reconstructing volumetric computed tomography (CT) images from surface images. Methods and Materials We conducted a retrospective analysis involving 50 patients with lung cancer who underwent radiation therapy and had 10-phase 4-dimensional CT (4DCT) scans during their treatment simulation. For each patient, we used 9 phases of 4DCT images for patient-specific model training and validation, reserving 1 phase for testing purposes. Our approach employed a surface-to-volume image synthesis framework, harnessing cycle-consistency generative adversarial networks to transform surface images into volumetric representations. The framework was extensively validated using an additional 6-patient cohort with resimulated 4DCT. Results The proposed technique has produced accurate volumetric CT images from the patient's body surface. In comparison with the ground truth CT images, those generated synthetically by the proposed method exhibited the gross tumor volume center of mass difference of 1.72 ± 0.87 mm, the overall mean absolute error of 36.2 ± 7.0 HU, structural similarity index measure of 0.94 ± 0.02, and Dice score coefficient of 0.81 ± 0.07. Furthermore, the robustness of the proposed framework was found to be linked to respiratory motion. Conclusions The proposed approach provides a novel solution to overcome the limitation of SGRT for lung cancer radiation therapy, which can potentially enable real-time volumetric imaging during radiation treatment delivery for accurate tumor tracking without radiation-induced risk. This data-driven framework offers a comprehensive solution to tackle motion management in radiation therapy, without necessitating the rigid application of first principles modeling for organ motion.

3D Structure Surface Modelling from Volumetric CT Images

Algorithm for Displaying Surfaces from Volume Data

Anatomical structure modeling from medical images

Three-Dimensional Surface Rendering and Computer-aided Diagnosis Based on CT Images

Surface Representation and Display of Anatomic Structures From CT-Examinations

Surface Carving-Based Automatic Volume Data Reduction

3-D Representation of Anatomic Structures from CT Examinations

Volumetric anatomical modeling from medical images

3D Organ Shape Reconstruction from Topogram Images

Reconstrucion and Visualization of 3D Surface Model from Serial-Sectioned Contour Points

Design and Implementation of Three Dimensional Visualization and Analysis System of Medical Images

Surface rendering of section planes based on brain volume data of Chinese virtual human

Data-Driven Volumetric Image Generation from Surface Structures using a Patient-Specific Deep Leaning Model

Data-Driven Volumetric Computed Tomography Image Generation From Surface Structures Using a Patient-Specific Deep Leaning Model

Topological 3D reconstruction of multiple anatomical structures from volumetric medical data

Study of Surface Reconstruction Based on Contours of CT Image Slices

Three-dimensional reconstruction of medical images based on VTK

Three-dimensional Volume Rendering of Spiral CT Data: Theory and Method

The production of digital and printed resources from multiple modalities using visualization and three-dimensional printing techniques

3D Surface Reconstruction of Complex Parts Based on Slice Images of Cone-beam Computed Tomography

Towards a Comprehensive, Efficient and Promptable Anatomic Structure Segmentation Model using 3D Whole-body CT Scans