Abstract:目的当前数字重建放射影像（digitally reconstructed radiograph，DRR）生成算法难以同时保证影像生成效率和质量。为此，提出一种基于循环一致性生成对抗网络（generative adversarial network，GAN）的新型DRR生成算法（cycle-GAN-DRR，CG-DRR），在保证生成效率的同时，兼顾生成影像与真实X射线影像的灰度和结构一致性。方法 CG-DRR算法包含数据预处理、网络训练和网络应用3个阶段。数据预处理阶段准备后续网络训练需要的图像数据；网络训练阶段使用预处理后的数据训练循环一致性生成对抗网络；在应用阶段，训练后网络输入光线跟踪法生成的DRR图像实现DRR图像灰度校正。结果使用4个常用图像相似性指标和2个梯度相似性指标分别评估原始DRR图像与灰度校正后的DRR图像的灰度和几何结构一致性。与传统光线跟踪法相比，盆腔和胸腔数据平均峰值信噪比分别提高18.22 dB和8.82 dB，平均绝对误差分别减少0.18和0.07，归一化均方根误差分别减少0.23和0.10，结构相似度指数分别提高23.5%和13.5%，与当前最新RealDRR算法结果指标相差无几。与RealDRR算法结果相比，CG-DRR算法在DRR图像灰度校正前后人体组织结构保持更好的一致性，盆腔和胸腔数据图像特征相似性指数分别提高0.02和0.03，梯度相似性偏差分别减少0.18和0.03。CG-DRR算法生成一幅DRR图像平均耗时0.31 s。结论本文创新性地将循环一致性生成对抗机制应用于DRR生成，所提算法可以很好地应对实际临床中DRR图像与X光影像存在结构偏差的问题，可在保证生成效率的前提下兼顾灰度相似性及结构一致性，相比于现有算法更具优势。;Objective Real-time tumor localization is essential for tumor tracking radiotherapy. Conventional tumor localization methods commonly estimate the tumor motion by measuring the similarity between the X-ray images and digitally reconstructed radiography（DRR）computed from computed tomography（CT）. However，due to the scatter，beam hardening and quantum noise，there exists intensity inconsistency between the X-ray projections and DRR which may compromise the accuracy of tumor localization. Thus，it is crucial to calculate DRR similar with the X-ray images for precise tumor localization. Current DRR-relevant methods can be segmented into two categories：1）statistical-based Monte Carlo（MC） simulation and 2）analysis-based ray tracing（RT）. The MC methods simulate the interaction process between photons and human tissue and can generate DRRs of high similarity with the X-ray projections. But it suffers from low computational efficiency which hinders its clinical application. The RT methods calculate DRR by simulating the absorption and attenuation process of X-ray penetrating human tissue. Compared to MC methods，the RT methods have higher computational efficiency，but there is a big intensity gap between their results and the real X-ray images. To address the problems mentioned above，we develop an improved cycle consistency generative adversarial network（Cycle-GAN）based DRR generation algorithm（CG-DRR），which can efficiently generate DRR with high similarity to the X-ray images. Method CG-DRR consists of two mapping functions Gy，Gx and associated adversarial discriminators Dy， Dx. The Gy is trained to generate DRRs indistinguishable from X-ray images based on DRR calculated by RT（DRRRT），while Dy aims to distinguish between generated DRRs and real X-ray images，and vice versa for Gx，Dx. The training loss for CG-DRR is composed of three elements：1） adversarial loss for matching the distribution of generated DRR to the X-ray distribution in the target domain；2）a cycle consistency L1-norm loss to prevent the learned mappings Gy，Gx from contradicting each other；and 3）gradient penalty configuration to stabilize network training. For validation，planning CT and CBCT（cone beam computed tomography）projections（X-ray images）for radiotherapy of 3 pelvic and 3 chest patients are collected. For the pelvic/chest data，the CGDRR is trained on 1 077/588 CBCT projections randomly selected from two patients and tested on 100/50 unseen CBCT projections from the same patients，and 100/50 CBCT projections randomly selected from the third patient. The third patient data was only used for testing to evaluate the inter-patient generalization performance of the CG-DRR. The overall framework is composed of three stages. In the data preprocessing stage，FDK（Feldkamp-Davis-Kress）algorithm is first used to reconstruct the 3D CBCT image based on the CBCT projections. Rigid registration is then performed to align the CT with CBCT. The DRRRT can be generated according to the geometric parameters of CBCT projections. The CBCT projections and DRRRT are rescaled to 256×256 pixels and their intensity is normalized into［0，1］. In the training stage，the parameters of CG-DRR are optimized using mini-batch（size = 4）stochastic gradient descent（SGD）and Adam solver（β1 = 0. 5） through alternating gradient descent steps on the discriminators and generators. The learning rate is fixed at 0. 001 in the first 100 epochs，and then decreased to 0 in the next 100 epochs linearly. In the application stage，the input of Gy is DRRRT，which is rescaled to 256×256 pixels and normalized into ［0，1］. The output of Gy is up-sampled and de-normalized to obtain a DRR with the same size and intensity range as the CBCT projections. Result Evaluation is performed by comparing the generated DRR to ground-truth CBCT projections in terms of the peak signal-to-noise ratio （PSNR），the mean absolute error（MAE），the normalized root-mean-square error（NRMSE），and the structural similarity index（SSIM）. To further evaluate the structural consistency，two additional indicators，feature similarity index measure （FSIM）and gradient magnitude similarity deviation（GMSD），are also evaluated. For RT，RealDRR and CG-DRR，1）the average PSNR are 11. 6 dB，32. 9 dB，29. 6 dB for pelvic data，16. 4 dB，31. 3 dB，25. 2 dB for chest data；2）the average MAE are 0. 21，0. 02，0. 03 for pelvic data and 0. 12，0. 03，0. 05 for chest data；and 3）the average NRMSE are 0. 27，0. 03，0. 04 for pelvic data and 0. 16，0. 04，0. 06 for chest data；4）the average SSIM are 0. 745，0. 985，0. 980 for pelvic data and 0. 840，0. 985，0. 975 for chest data. But，the results of RealDRR contain noticeable structural distortions，with faked or missed tissue structures compared with DRRRT. Especially for chest data，the position of the thoracic diaphragm is significantly shifted. Compared with the results of RealDRR，CG-DRR can keep a good consistency of tissue structure. For the average FSIM，the pelvic results are increased from 0. 855 to 0. 870，an improvement of 2%；the chest results are increased from 0. 91 to 0. 93，an improvement of 2. 2%. For the average GMSD，the pelvic results decreased from 0. 175 to 0. 17，a reduction of 2. 9%；the chest results decreased from 0. 135 to 0. 115，a reduction of 14. 8%. For computational efficiency，the CG-DRR can render a highly realistic DRR in 0. 31 s. Conclusion The cycle-consistent generative adversarial mechanism is applied to DRR generation. The proposed algorithm can efficiently generate DRR that has good intensity similarity and structural consistency with X-ray projections.

Enhanced digitally reconstructed radiographs generated by ray tracing]

Research on CT Simulation Used in Radiation Treatment Planning

Fast Generation of Digitally Reconstructed Radiograph Through an Efficient Preprocessing of Ray Attenuation Values

GPU implementation of ray-tracing algorithm for digitally reconstructed radiography

Point-Based Digitally Reconstructed Radiograph

SU-E-J-112: A Splatting Method to Generate DRRs for Deformed CT Volume

Registration of On-Board X-ray Images with 4DCT: A Proposed Method of Phase and Setup Verification for Gated Radiotherapy

Isocentric fixed angle irradiation-based DRR: a novel approach to enhance x-ray and CT image registration

Digitally reconstructed radiography based on Monte Carlo integral

CBCT-DRRs superior to CT-DRRs for target-tracking applications for pancreatic SBRT

Accelerating Reconstruction of Reference Digital Tomosynthesis Using Graphics Hardware

AN ATTENUATION COEFFICIENT RECONSTRUCTION ALGORITHM FOR DUALPROJECTION DIGITAL RADIOGRAPHY VEHICLE INSPECTION SYSTEM

DR-only Carbon-ion Radiotherapy Treatment Planning Via Deep Learning

CG-DRR:digital reconstructed radiograph generation algorithm based on Cycle-GAN

DDGS-CT: Direction-Disentangled Gaussian Splatting for Realistic Volume Rendering

Fast reconstructed radiographs from octree-compressed volumetric data

Creating Patient-Specific Digital Phantoms with a Longitudinal Atlas for Evaluating Deformable CT-CBCT Registration in Adaptive Lung Radiotherapy

Application of Digital Images in Quality Assurance of Radiotherapy

Lifelike PixelPrint phantoms for assessing clinical image quality and dose reduction capabilities of a deep learning CT reconstruction algorithm

A Novel Digital Tomosynthesis (DTS) Reconstruction Method Using a Deformation Field Map

A high-resolution cone beam computed tomography (HRCBCT) reconstruction framework for CBCT-guided online adaptive therapy