Abstract:Purpose: Deep learning model has shown the feasibility of providing spatial lung perfusion information based on CT images. However, the performance of this method on lung cancer patients is yet to be investigated. This study aims to develop a transfer learning framework to evaluate the deep learning based CT-to-perfusion mapping method specifically on lung cancer patients. Methods: SPECT/CT perfusion scans of 33 lung cancer patients and 137 non-cancer patients were retrospectively collected from two hospitals. To adapt the deep learning model on lung cancer patients, a transfer learning framework was developed to utilize the features learned from the non-cancer patients. These images were processed to extract features from three-dimensional CT images and synthesize the corresponding CT-based perfusion images. A pre-trained model was first developed using a dataset of patients with lung diseases other than lung cancer, and subsequently fine-tuned specifically on lung cancer patients under three-fold cross-validation. A multi-level evaluation was performed between the CT-based perfusion images and ground-truth SPECT perfusion images in aspects of voxel-wise correlation using Spearman's correlation coefficient (R), function-wise similarity using Dice Similarity Coefficient (DSC), and lobe-wise agreement using mean perfusion value for each lobe of the lungs. Results: The fine-tuned model yielded a high voxel-wise correlation (0.8142 ± 0.0669) and outperformed the pre-trained model by approximately 8%. Evaluation of function-wise similarity indicated an average DSC value of 0.8112 ± 0.0484 (range: 0.6460-0.8984) for high-functional lungs and 0.8137 ± 0.0414 (range: 0.6743-0.8902) for low-functional lungs. Among the 33 lung cancer patients, high DSC values of greater than 0.7 were achieved for high functional volumes in 32 patients and low functional volumes in all patients. The correlations of the mean perfusion value on the left upper lobe, left lower lobe, right upper lobe, right middle lobe, and right lower lobe were 0.7314, 0.7134, 0.5108, 0.4765, and 0.7618, respectively. Conclusion: For lung cancer patients, the CT-based perfusion images synthesized by the transfer learning framework indicated a strong voxel-wise correlation and function-wise similarity with the SPECT perfusion images. This suggests the great potential of the deep learning method in providing regional-based functional information for functional lung avoidance radiation therapy.

Vision Intelligence Assisted Lung Function Estimation Based on Transformer Encoder-Decoder Network With Invertible Modeling.

BreathVisionNet: A Pulmonary-function-guided CNN-Transformer Hybrid Model for Expiratory CT Image Synthesis

A vision transformer for emphysema classification using CT images

[Application of electrical impedance tomography imaging technology combined with generative adversarial network in pulmonary ventilation monitoring]

LungViT: Ensembling Cascade of Texture Sensitive Hierarchical Vision Transformers for Cross-Volume Chest CT Image-to-Image Translation

Deep learning based reconstruction enables high-resolution electrical impedance tomography for lung function assessment

Deriving ventilation imaging from 4DCT by deep convolutional neural network

Deriving Pulmonary Ventilation Images From Clinical 4D-CBCT Using a Deep Learning-Based Model

CoVid-19 Detection leveraging Vision Transformers and Explainable AI

Convolutional Neural Network–Vision Transformer Architecture with Gated Control Mechanism and Multi-Scale Fusion for Enhanced Pulmonary Disease Classification

Diff3Dformer: Leveraging Slice Sequence Diffusion for Enhanced 3D CT Classification with Transformer Networks

Four Transformer-Based Deep Learning Classifiers Embedded with an Attention U-Net-Based Lung Segmenter and Layer-Wise Relevance Propagation-Based Heatmaps for COVID-19 X-ray Scans

BeyondCT: A deep learning model for predicting pulmonary function from chest CT scans

A Transfer Learning Framework for Deep Learning-Based CT-to-Perfusion Mapping on Lung Cancer Patients

A deep learning model for translating CT to ventilation imaging: analysis of accuracy and impact on functional avoidance radiotherapy planning

Spatio-Temporal Classification of Lung Ventilation Patterns using 3D EIT Images: A General Approach for Individualized Lung Function Evaluation

Application of Vision-Series Transformer in Screening for Coronary Heart Diseases Using Coronary CT Angiography.

3D Multi-Scale Vision Transformer for Lung Nodule Detection in Chest CT Images

Motion and anatomy dual aware lung ventilation imaging by integrating Jacobian map and average CT image using dual path fusion network

Vision Transformer-based Model for Severity Quantification of Lung Pneumonia Using Chest X-ray Images

Deep-Learning-Based Few-Angle Cardiac SPECT Reconstruction Using Transformer