[Women's attitude to the gynecological examination].

G. Ivarsson,G. Röckner,G. Westin-Lindgren,A. Olund

1981-11-01

Abstract:

What problem does this paper attempt to address?

Deep match: A zero-shot framework for improved fiducial-free respiratory motion tracking

Di Xu,Martina Descovich,Hengjie Liu,Yi Lao,Alexander R Gottschalk,Ke Sheng,Alexander R. Gottschalk

DOI: https://doi.org/10.1016/j.radonc.2024.110179

IF: 6.901

2024-05-01

Radiotherapy and Oncology

Abstract:BACKGROUND AND PURPOSE: Motion management is essential to reduce normal tissue exposure and maintain adequate tumor dose in lung stereotactic body radiation therapy (SBRT). Lung SBRT using an articulated robotic arm allows dynamic tracking during radiation dose delivery. Two stereoscopic X-ray tracking modes are available - fiducial-based and fiducial-free tracking. Although X-ray detection of implanted fiducials is robust, the implantation procedure is invasive and inapplicable to some patients and tumor locations. Fiducial-free tracking relies on tumor contrast, which challenges the existing tracking algorithms for small (e.g., <15 mm) and/or tumors obscured by overlapping anatomies. To markedly improve the performance of fiducial-free tracking, we proposed a deep learning-based template matching algorithm - Deep Match.METHOD: Deep Match consists of four self-definable stages - training-free feature extractor, similarity measurements for location proposal, local refinements, and uncertainty level prediction for constructing a more trustworthy and versatile pipeline. Deep Match was validated on a 10 (38 fractions; 2661 images) patient cohort whose lung tumor was trackable on one X-ray view, while the second view did not offer sufficient conspicuity for tumor tracking using existing methods. The patient cohort was stratified into subgroups based on tumor sizes (<10 mm, 10-15 mm, and >15 mm) and tumor locations (with/without thoracic anatomy overlapping).RESULTS: On X-ray views that conventional methods failed to track the lung tumor, Deep Match achieved robust performance as evidenced by >80 % 3 mm-Hit (detection within 3 mm superior/inferior margin from ground truth) for 70 % of patients and <3 mm superior/inferior distance (SID) ∼1 mm standard deviation for all the patients.CONCLUSION: Deep Match is a zero-shot learning network that explores the intrinsic neural network benefits without training on patient data. With Deep Match, fiducial-free tracking can be extended to more patients with small tumors and with tumors obscured by overlapping anatomy.

oncology,radiology, nuclear medicine & medical imaging
Automated Clinical Target Volume Delineation Using Deep 3D Neural Networks in Radiation Therapy of Non-small Cell Lung Cancer

Yunhe Xie,Kongbin Kang,Yi Wang,Melin J. Khandekar,Henning Willers,Florence K. Keane,Thomas R. Bortfeld

DOI: https://doi.org/10.1016/j.phro.2021.08.003

2021-01-01

Physics and Imaging in Radiation Oncology

Abstract:Background and purpose: Clinical targeted volume (CTV) delineation accounting for the patient-specific microscopic tumor spread can be a difficult step in defining the treatment volume. We developed an intelligent and automated CTV delineation system for locally advanced non-small cell lung carcinoma (NSCLC) to cover the microscopic tumor spread while avoiding organs-at-risk (OAR). Materials and methods: A 3D UNet with a customized loss function was used, which takes both the patients' respiration-correlated ("4D") CT scan and the physician contoured internal gross target volume (iGTV) as inputs, and outputs the CTV delineation. Among the 84 identified patients, 60 were randomly selected to train the network, and the remaining as testing. The model performance was evaluated and compared with cropped expansions using the shape similarities to the physicians' contours (the ground-truth) and the avoidance of critical OARs. Results: On the testing datasets, all model-predicted CTV contours followed closely to the ground truth, and were acceptable by physicians. The average dice score was 0.86. Our model-generated contours demonstrated better agreement with the ground-truth than the cropped 5 mm/8 mm expansion method (median of median surface distance of 1.0 mm vs 1.9 mm/2.0 mm), with a small overlap volume with OARs (0.4 cm(3) for the esophagus and 1.2 cm(3) for the heart). Conclusions: The CTVs generated by our CTV delineation system agree with the physician's contours. This approach demonstrates the capability of intelligent volumetric expansions with the potential to be used in clinical practice.
Assessment of fiducial motion in CBCT projections of the abdominal tumor using template matching and sequential stereo triangulation

Oluwaseyi M. Oderinde,Hassan Mostafavi,Daniel Simpson,James Murphy,Gwe-Ya Kim,Laura I. Cervino

DOI: https://doi.org/10.48550/arXiv.2211.05380

2022-11-10

Abstract:Purpose: To assess the fiducial motion in abdominal stereotactic body radiotherapy (SBRT) using the cone-beam computed tomography (CBCT) projections acquired for pre-treatment patient set-up. Materials and Methods: Pre-treatment CBCT projections and anterior-posterior (AP) and lateral (LAT) pair of fluoroscopic sequences of 7 pancreatic and 6 liver SBRT patients with implanted fiducials were analyzed for 49 treatment fractions retrospectively. A tracking algorithm based on template matching and sequential stereo triangulation algorithms was used to track the fiducials in the CBCT projections and the fluoro sequence pairs. We predicted the clinical couch adjustment from CBCT tracking and compared it with the clinical couch decision made during the patient's treatment. Results: In 3D coordinate, the fiducial motion ranges for pancreas cases were 9.90+/-3.52 mm, 10.65+/-5.91 mm, and 10.74+/-6.24 mm for CBCT, AP, and LAT fluoro, respectively, while in the liver, they were 13.93+/-3.39 mm, 11.17+/-3.75 mm, and 11.52+/-4.33 mm, respectively. Prediction of couch adjustment in LAT, SI, and AP coordinates from CBCT tracking agrees with the actual clinical couch correction within 0.92+/-0.74 mm, 1.37+/-1.26 mm, and 0.68+/-0.56 mm for pancreas cases and within 1.12+/-0.96 mm, 1.15+/-0.92 mm and 0.90+/-0.86 mm for liver cases, respectively. Conclusion: Tracking pre-treatment CBCT projections using template matching and sequential stereo triangulation is suitable for assessing fiducial motion and adjusting the patient setup for abdominal SBRT. CBCT can be used for motion modeling, potentially eliminating the need for additional fluoroscopic pair acquisition and thus reducing the imaging dose to the patient and the total treatment time.

Medical Physics
MA13.01 Markerless Tumor Tracking During Lung Radiotherapy Using Intrafraction X-Ray Imaging

Chun-Chien (Andy) Shieh,Vincent Caillet,Michelle Dunbar,Paul Keall,Nicholas Hardcastle,Jeremy Booth,Chen-Yu Huang,Carol Haddad,Thomas Eade,Ilana Feain

DOI: https://doi.org/10.1016/j.jtho.2016.11.478

IF: 20.121

2017-01-01

Journal of Thoracic Oncology

Abstract:Lung tumors often exhibit large and unpredictable motion that can severely compromise radiotherapy outcomes. Markerless tumor tracking can enable wide access to motion-adaptive radiotherapy, negating the risks and costs associated with implanting markers. The main barrier to markerless tumor tracking is the inferior tumor visibility on x-ray images due to overlapping anatomic structures. The aim of this study is to develop a markerless tumor tracking method for lung radiotherapy using intrafraction x-ray imaging. The markerless tumor tracking method (Figure1a) consists of four steps: (1) Building a tumor and anatomic model from the cone-beam CT (CBCT) acquired prior to treatment, (2) Using the anatomic model to remove the contribution of anatomic structures on intrafraction x-ray images, (3) Locating the tumor on the intrafraction 2D x-ray image via template matching using the tumor model, (4) Determining the tumor 3D position by a Kalman filter. The proposed method was retrospectively validated on (i) 11 CBCT scans from four patients with central tumors, and (ii) a kV fluoroscopic scan during a stereotactic ablative radiotherapy (SABR) treatment from the Light SABR trial (NCT02514512). Tracking errors were estimated using the motions of markers or beacons implanted near the tumors. Markerless tumor tracking successfully tracked tumors in all cases at every imaging angle. The mean 3D tracking error ranged from 1.8-4.1mm for the 11 CBCT scans, and was 3.0mm for the SABR case. Compared with the current standard of care, i.e. a single estimation of tumor position prior to treatment from the pre-treatment CBCT, markerless tumor tracking reduced tumor localization error by 0.9-7.9mm. Tracking errors in the left-right, superior-inferior, and anterior-posterior directions are shown in Figure1b. A markerless tumor tracking method was developed and shown to improve tumor localization accuracy in 12 lung cancer cases. This method can potentially enable wide access to motion-adaptive radiotherapy.
Simultaneous object detection and segmentation for patient-specific markerless lung tumor tracking in simulated radiographs with deep learning

Lili Huang,Christopher Kurz,Philipp Freislederer,Farkhad Manapov,Stefanie Corradini,Maximilian Niyazi,Claus Belka,Guillaume Landry,Marco Riboldi

DOI: https://doi.org/10.1002/mp.16705

Abstract:Background: Real-time tumor tracking is one motion management method to address motion-induced uncertainty. To date, fiducial markers are often required to reliably track lung tumors with X-ray imaging, which carries risks of complications and leads to prolonged treatment time. A markerless tracking approach is thus desirable. Deep learning-based approaches have shown promise for markerless tracking, but systematic evaluation and procedures to investigate applicability in individual cases are missing. Moreover, few efforts have been made to provide bounding box prediction and mask segmentation simultaneously, which could allow either rigid or deformable multi-leaf collimator tracking. Purpose: The purpose of this study was to implement a deep learning-based markerless lung tumor tracking model exploiting patient-specific training which outputs both a bounding box and a mask segmentation simultaneously. We also aimed to compare the two kinds of predictions and to implement a specific procedure to understand the feasibility of markerless tracking on individual cases. Methods: We first trained a Retina U-Net baseline model on digitally reconstructed radiographs (DRRs) generated from a public dataset containing 875 CT scans and corresponding lung nodule annotations. Afterwards, we used an independent cohort of 97 lung patients to develop a patient-specific refinement procedure. In order to determine the optimal hyperparameters for automatic patient-specific training, we selected 13 patients for validation where the baseline model predicted a bounding box on planning CT (PCT)-DRR with intersection over union (IoU) with the ground-truth higher than 0.7. The final test set contained the remaining 84 patients with varying PCT-DRR IoU. For each testing patient, the baseline model was refined on the PCT-DRR to generate a patient-specific model, which was then tested on a separate 10-phase 4DCT-DRR to mimic the intrafraction motion during treatment. A template matching algorithm served as benchmark model. The testing results were evaluated by four metrics: the center of mass (COM) error and the Dice similarity coefficient (DSC) for segmentation masks, and the center of box (COB) error and the DSC for bounding box detections. Performance was compared to the benchmark model including statistical testing for significance. Results: A PCT-DRR IoU value of 0.2 was shown to be the threshold dividing inconsistent (68%) and consistent (100%) success (defined as mean bounding box DSC > 0.6) of PS models on 4DCT-DRRs. Thirty-seven out of the eighty-four testing cases had a PCT-DRR IoU above 0.2. For these 37 cases, the mean COM error was 2.6 mm, the mean segmentation DSC was 0.78, the mean COB error was 2.7 mm, and the mean box DSC was 0.83. Including the validation cases, the model was applicable to 50 out of 97 patients when using the PCT-DRR IoU threshold of 0.2. The inference time per frame was 170 ms. The model outperformed the benchmark model on all metrics, and the comparison was significant (p < 0.001) over the 37 PCT-DRR IoU > 0.2 cases, but not over the undifferentiated 84 testing cases. Conclusions: The implemented patient-specific refinement approach based on a pre-trained baseline model was shown to be applicable to markerless tumor tracking in simulated radiographs for lung cases.
Fluoroscopic Tumor Tracking for Image-Guided Lung Cancer Radiotherapy.

Tong Lin,Laura I. Cervino,Xiaoli Tang,Nuno Vasconcelos,Steve B. Jiang

DOI: https://doi.org/10.1088/0031-9155/54/4/011

IF: 3.5

2009-01-01

Physics in Medicine and Biology

Abstract:Accurate lung tumor tracking in real time is a keystone to image-guided radiotherapy of lung cancers. Existing lung tumor tracking approaches can be roughly grouped into three categories: (1) deriving tumor position from external surrogates; (2) tracking implanted fiducial markers fluoroscopically or electromagnetically; (3) fluoroscopically tracking lung tumor without implanted fiducial markers. The first approach suffers from insufficient accuracy, while the second may not be widely accepted due to the risk of pneumothorax. Previous studies in fluoroscopic markerless tracking are mainly based on template matching methods, which may fail when the tumor boundary is unclear in fluoroscopic images. In this paper we propose a novel markerless tumor tracking algorithm, which employs the correlation between the tumor position and surrogate anatomic features in the image. The positions of the surrogate features are not directly tracked; instead, we use principal component analysis of regions of interest containing them to obtain parametric representations of their motion patterns. Then, the tumor position can be predicted from the parametric representations of surrogates through regression. Four regression methods were tested in this study: linear and two-degree polynomial regression, artificial neural network (ANN) and support vector machine (SVM). The experimental results based on fluoroscopic sequences of ten lung cancer patients demonstrate a mean tracking error of 2.1 pixels and a maximum error at a 95% confidence level of 4.6 pixels (pixel size is about 0.5 mm) for the proposed tracking algorithm.
WE-AB-303-08: Direct Lung Tumor Tracking Using Short Imaging Arcs

C. Shieh,C. Huang,P. Keall,I. Feain

DOI: https://doi.org/10.1118/1.4925873

IF: 4.506

2015-01-01

Medical Physics

Abstract:Purpose: Most current tumor tracking technologies rely on implanted markers, which suffer from potential toxicity of marker placement and mis-targeting due to marker migration. Several markerless tracking methods have been proposed: these are either indirect methods or have difficulties tracking lung tumors in most clinical cases due to overlapping anatomies in 2D projection images. We propose a direct lung tumor tracking algorithm robust to overlapping anatomies using short imaging arcs. Methods: The proposed algorithm tracks the tumor based on kV projections acquired within the latest six-degree imaging arc. To account for respiratory motion, an external motion surrogate is used to select projections of the same phase within the latest arc. For each arc, the pre-treatment 4D cone-beam CT (CBCT) with tumor contours are used to estimate and remove the contribution to the integral attenuation from surrounding anatomies. The position of the tumor model extracted from 4D CBCT of the same phase is then optimized to match the processed projections using the conjugate gradient method. The algorithm was retrospectively validated on two kV scans of a lung cancer patient with implanted fiducial markers. This patient was selected as the tumor is attached to the mediastinum, representing a challenging case for markerless tracking methods. The tracking results were converted to expected marker positions and compared with marker trajectories obtained via direct marker segmentation (ground truth). Results: The root-mean-squared-errors of tracking were 0.8 mm and 0.9 mm in the superior-inferior direction for the two scans. Tracking error was found to be below 2 and 3 mm for 90% and 98% of the time, respectively. Conclusions: A direct lung tumor tracking algorithm robust to overlapping anatomies was proposed and validated on two scans of a lung cancer patient. Sub-millimeter tracking accuracy was observed, indicating the potential of this algorithm for real-time guidance applications.
Predicting successful clinical candidates for fiducial-free lung tumor tracking with a deep learning binary classification model

Matthieu Lafrenière,Gilmer Valdes,Martina Descovich

2023-08-24

Abstract:The CyberKnife system is a robotic radiosurgery platform that allows the delivery of lung SBRT treatments using fiducial-free soft-tissue tracking. However, not all lung cancer patients are eligible for lung tumor tracking. Tumor size, density and location impact the ability to successfully detect and track a lung lesion in 2D orthogonal X-ray images. The standard workflow to identify successful candidates for lung tumor tracking is called Lung Optimized Treatment (LOT) simulation, and involves multiple steps from CT acquisition to the execution of the simulation plan on CyberKnife. The aim of the study is to develop a deep learning classification model to predict which patients can be successfully treated with lung tumor tracking, thus circumventing the LOT simulation process. Target tracking is achieved by matching orthogonal x-ray images with a library of digital radiographs reconstructed from the simulation CT scan (DRRs). We developed a deep learning model to create a binary classification of lung lesions as being trackable or untrackable based on tumor template DRR extracted from the CyberKnife system, and tested five different network architectures. The study included a total of 271 images (230 trackable, 41 untrackable) from 129 patients with one or multiple lung lesions. 80% of the images were used for training, 10% for validation, and the remaining 10% for testing. For all 5 convolutional neural networks, the binary classification accuracy reached 100% after training, both in the validation and the test set, without any false classifications. A deep learning model can distinguish features of trackable and untrackable lesions in DRR images, and can predict successful candidates for fiducial-free lung tumor tracking.

Medical Physics
TU-C-214-03: Markerless Tumor Tracking Via Clustering on Low-Rank Fluoroscopic Images for Image-Guided Lung Cancer Radiotherapy

Wei Huang,Xun Jia,Bin Dong,Xuejun Gu,Laura Cervino,Hao Gao,Jian-Feng Cai,Steve B. Jiang

DOI: https://doi.org/10.1118/1.3613135

2011-01-01

Abstract:Purpose: Fluoroscopic tumor tracking without implanted fiducial markers in image-guided lung cancer radiotherapy is an important yet challenging research topic nowadays. In this study, a novel strategy using clustering on low-rank fluoroscopic images is proposed for lung tumor tracking. Methods: Precisely localizing lung tumor position in fluoroscopic images is difficult because of either the obscure boundary between the tumor region and its surrounded non-tumor tissues or concurrent movement of both tumor and non-tumor tissues. A fluoroscopic image is first decomposed into low-rank and sparse components based on a Robust-PCA model via a split Bregman method in this study. The purpose is to obtain low-rank fluoroscopic images with less movement of non-tumor tissues. Later, a k-means clustering algorithm is applied on low-rank fluoroscopic images to differentiate tumor from non-tumor tissues. A morphological process and a connected components analysis are also incorporated on clustering results to determine detected tumor regions for tracking. Results: 400 fluoroscopic images obtained from 3 patients with lung cancer are utilized to evaluate the performance of the proposed tumor tracking strategy. Another strategy, which conducts the same tracking steps via clustering but directly on fluoroscopic images, is implemented for comparison. Experimental results and statistical analysis demonstrate that clustering on low-rank fluoroscopic images performs significantly better than performing clustering directly on fluoroscopic images for lung tumor tracking. Also, tracking results obtained by the newly proposed strategy are more stable, and they are less likely to be influenced by non-tumor tissues around the tumor region in fluoroscopic images, which often happens when applying clustering directly on fluoroscopic images. Conclusions: A novel markerless tumor tracking strategy via clustering on low-rank fluoroscopic images for image-guided lung cancer radiotherapy is proposed. Promising results are demonstrated by testing the proposed strategy on real patient data. Acknowledgement: The authors would like to acknowledge the supported from Varian Medical Systems, Inc.
Markerless Lung Tumor Localization From Intraoperative Stereo Color Fluoroscopic Images for Radiotherapy

Yongxuan Yan,Fumitake Fujii,Takehiro Shiinoki,Shengping Liu

DOI: https://doi.org/10.1109/access.2024.3376744

IF: 3.9

2024-03-27

IEEE Access

Abstract:Accurately determining tumor regions from stereo fluoroscopic images during radiotherapy is a challenging task. As a result, high-density fiducial markers are implanted around tumors in clinical practice as internal surrogates of the tumor, which leads to associated surgical risks. This study was conducted to achieve lung tumor localization without the use of fiducial markers. We propose training a cascade U-net system to perform color to grayscale conversion, enhancement, bone suppression, and tumor detection to determine the precise tumor region. We generated Digitally Reconstructed Radiographs (DRRs) and tumor labels from 4D planning CT images as training data. An improved maximum projection algorithm and a novel color-to-gray conversion algorithm were proposed to improve the quality of the generated training data. Training a bone suppression model using bone-enhanced and bone-suppressed DRRs enables the bone suppression model to achieve better bone suppression performance. The mean peak signal-to-noise ratios in the test sets of the trained translation and bone suppression models are 39.284 ± 0.034 dB and 37.713 ± 0.724 dB, respectively. The results indicate that our proposed markerless tumor localization method is applicable in seven out of ten cases; in applicable cases, the centroid position error of the tumor detection model is less than 1.13 mm; and the calculated tumor center motion trajectories using the proposed network highly coincide with the motion trajectories of implanted fiducial markers in over 60% of captured groups, providing a promising direction for markerless tumor localization tracking methods.

computer science, information systems,telecommunications,engineering, electrical & electronic
Markerless Tumor Tracking Using Short Kilovoltage Imaging Arcs for Lung Image-Guided Radiotherapy

Chun-Chien Shieh,Paul J. Keall,Zdenka Kuncic,Chen-Yu Huang,Ilana Feain

DOI: https://doi.org/10.1088/0031-9155/60/24/9437

IF: 3.5

2015-01-01

Physics in Medicine and Biology

Abstract:The ability to monitor tumor motion without implanted markers is clinically advantageous for lung image-guided radiotherapy (IGRT). Existing markerless tracking methods often suffer from overlapping structures and low visibility of tumors on kV projection images. We introduce the short arc tumor tracking (SATT) method to overcome these issues. The proposed method utilizes multiple kV projection images selected from a nine-degree imaging arc to improve tumor localization, and respiratory-correlated 4D cone-beam CT (CBCT) prior knowledge to minimize the effects of overlapping anatomies. The 3D tumor position is solved as an optimization problem with prior knowledge incorporated via regularization. We retrospectively validated SATT on 11 clinical scans from four patients with central tumors. These patients represent challenging scenarios for markerless tumor tracking due to the inferior adjacent contrast. The 3D trajectories of implanted fiducial markers were used as the ground truth for tracking accuracy evaluation. In all cases, the tumors were successfully tracked at all gantry angles. Compared to standard pre-treatment CBCT guidance alone, trajectory errors were significantly smaller with tracking in all cases, and the improvements were the most prominent in the superior-inferior direction. The mean 3D tracking error ranged from 2.2-9.9 mm, which was 0.4-2.6 mm smaller compared to pre-treatment CBCT. In conclusion, we were able to directly track tumors with inferior visibility on kV projection images using SATT. Tumor localization accuracies are significantly better with tracking compared to the current standard of care of lung IGRT. Future work involves the prospective evaluation and clinical implementation of SATT.
A Real-Time Tracking and Visualization System for Robot-Assisted Template Location Method Applied to Lung Cancer Brachytherapy

Xiaodong Ma,Shan Jiang,Zhiyong Yang,Guobin Zhang,Zhonghua Yu,Shude Chai

DOI: https://doi.org/10.1115/1.4042542

2019-01-31

Journal of Medical Devices

Abstract:Accurate location of the puncture-guiding template, including the position and orientation, is essential for surgeons to implant radioactive seeds into an internal tumor in lung cancer brachytherapy. The objective of this paper is to establish a real-time tracking and visualization system (RTVS) to monitor the robot-assisted location process distantly and confirm the ultimate location accuracy without redundant computed tomography (CT) scans. RTVS consists of tracking and visualization components. A quaternion-based iterative closest point (QICP) algorithm for higher accuracy was proposed for the premised module of spatial registration. Arithmetic accuracy of QICP and clinical performance of RTVS were both validated by a series of experiments in a CT room. Spatial registration experiment shows that QICP consistently presents a distinctly higher degree of accuracy of 0.87±0.11 mm compared with other two conventional algorithms. RTVS, evaluated by tracking and visualization experiments, achieves a tracking accuracy of 1.05±0.05 mm position and (0.29±0.14) deg orientation. In addition, the time cost for template location is greatly reduced, so are the CT scan times. RTVS has the potential on lessening the workload of surgeons, reducing the CT radiation injury to the patient, and accelerating the progress of a brachytherapy surgery. The system presented means a new contribution to the lung cancer brachytherapy.
Deep learning‐based target decomposition for markerless lung tumor tracking in radiotherapy

Yabo Fu,Pengpeng Zhang,Qiyong Fan,Weixing Cai,Hai Pham,Andreas Rimner,John Cuaron,Laura Cervino,Jean M. Moran,Tianfang Li,Xiang Li

DOI: https://doi.org/10.1002/mp.17039

IF: 4.506

2024-03-22

Medical Physics

Abstract:Background In radiotherapy, real‐time tumor tracking can verify tumor position during beam delivery, guide the radiation beam to target the tumor, and reduce the chance of a geometric miss. Markerless kV x‐ray image‐based tumor tracking is challenging due to the low tumor visibility caused by tumor‐obscuring structures. Developing a new method to enhance tumor visibility for real‐time tumor tracking is essential. Purpose To introduce a novel method for markerless kV image‐based tracking of lung tumors via deep learning‐based target decomposition. Methods We utilized a conditional Generative Adversarial Network (cGAN), known as Pix2Pix, to build a patient‐specific model and generate the synthetic decomposed target image (sDTI) to enhance tumor visibility on the real‐time kV projection images acquired by the onboard kV imager equipped on modern linear accelerators. We used 4DCT simulation images to generate the digitally reconstructed radiograph (DRR) and DTI image pairs for model training. We augmented the training dataset by randomly shifting the 4DCT in the superior‐inferior, anterior‐posterior, and left‐right directions during the DRR and DTI generation process. We performed real‐time 2D tumor tracking via template matching between the DTI generated from the CT simulation and the sDTI generated from the real‐time kV projection images. We validated the proposed method using nine patients' datasets with implanted beacons near the tumor. Results The sDTI can effectively improve the image contrast around the lung tumors on the kV projection images for the nine patients. With the beacon motion as ground truth, the tracking errors were on average 0.8 ± 0.7 mm in the superior‐inferior (SI) direction and 0.9 ± 0.8 mm in the in‐plane left‐right (IPLR) direction. The percentage of successful tracking, defined as a tracking error less than 2 mm in the SI direction, is 92.2% on the 4312 tested images. The patient‐specific model took approximately 12 h to train. During testing, it took approximately 35 ms to generate one sDTI, and 13 ms to perform the tumor tracking using template matching. Conclusions Our method offers the potential solution for nearly real‐time markerless lung tumor tracking. It achieved a high level of accuracy and an impressive tracking rate. Further development of 3D lung tumor tracking is warranted.

radiology, nuclear medicine & medical imaging
Automatic target positioning and tracking for image-guided radiotherapy without implanted fiducials

Wei Zhao,Liyue Shen,Yan Wu,Bin Han,Yong Yang,Lei Xing

DOI: https://doi.org/10.48550/arXiv.1906.08427

IF: 4.506

2019-06-20

Medical Physics

Abstract:Current image-guided prostate radiotherapy often relies on the use of implanted fiducials or transducers for target localization. Fiducial or transducer insertion requires an invasive procedure that adds cost and risks for bleeding, infection, and discomfort to some patients. We are developing a novel markerless prostate localization strategy using a pre-trained deep learning model to interpret routine projection kV X-ray images without the need for daily cone-beam computed tomography (CBCT). A deep learning model was first trained by using several thousand annotated projection X-ray images. The trained model is capable of identifying the location of the prostate target for a given input X-ray projection image. To assess the accuracy of the approach, three patients with prostate cancer received volumetric modulated arc therapy (VMAT) were retrospectively studied. The results obtained by using the deep learning model and the actual position of the prostate were compared quantitatively. The deviations between the target positions obtained by the deep learning model and the corresponding annotations ranged from 1.66 mm to 2.77 mm for anterior-posterior (AP) direction, and from 1.15 mm to 2.88 mm for lateral direction. Target position provided by deep learning model for the kV images acquired using OBI is found to be consistent that derived from the fiducials. This study demonstrates, for the first time, that highly accurate markerless prostate localization based on deep learning is achievable. The strategy provides a clinically valuable solution to daily patient positioning and real-time target tracking for image-guided radiotherapy (IGRT) and interventions.
Markerless tracking of tumor and tissues: A motion model approach

Ling Fung Cheung,Shinichirou Fujitaka,Takaaki Fujii,Naoki Miyamoto,Seishin Takao

DOI: https://doi.org/10.1002/mp.17524

IF: 4.506

2024-11-22

Medical Physics

Abstract:Background Respiratory motion management is essential in order to achieve high‐precision radiotherapy. Markerless motion tracking of tumor can provide a non‐invasive way to manage respiratory motion, thereby enhancing treatment accuracy. However, the low contrast in real‐time x‐ray images for image guidance limits the application of markerless tracking. Purpose We present a novel approach based on a motion model to perform markerless tracking of tumor and surrounding tissues even when they have low contrast in real‐time x‐ray images. Methods A proof‐of‐concept validation of the method has been performed using digital and physical phantoms at breathing conditions that are significantly different than the planning stage. A motion model is first constructed by performing principal component analysis (PCA) on the planning 4DCT. During treatment, the motion of a surrogate is tracked and used as the input of the motion model, which generates a 3D real‐time volume estimation. Such 3D estimation is then projected to 2D to create digitally reconstructed radiographs (DRRs). The relationships between the real‐time DRRs, reference DRRs, and reference x‐ray images are first established to simulate 2D real‐time images from the real‐time volume. The registration between the simulated 2D real‐time images and real‐time x‐ray images corrects the initial motion model estimation to ensure the estimated volume matches the real‐time condition. Results In digital phantom, the Dice index of pancreas was improved from 0.74 to 0.78 after correction using real‐time DRRs in fully inhaled phase. Validation on lung and pancreas is performed in physical phantom with two motion traces. The surrogate‐tumor relationships were intentionally altered to generate large target localization errors due to the differences in body condition between treatment planning stage and during treatment. The real‐time correction for the estimated 3D real‐time volume was performed using a pair of 2D x‐ray images. For the deep breathing motion trace, the tumor localization mean absolute error (MAE) throughout the tracking decreases from around 3 mm to less than 1 mm after correction. For the shallow breathing motion trace with a 1.7 mm baseline shift, the tumor localization MAE throughout the tracking decreases from around 1.5 mm to less than 1 mm after correction. Conclusion The method combines the detailed structural information from planning 4DCT and real‐time information from real‐time x‐ray images through a motion model. The matching between the real‐time model estimation and 2D real‐time images is performed in the same modality so that it can be applied to regions with low contrast in the images. The real‐time images successfully corrected the initial motion model estimations in our proof‐of‐concept validation. This suggests the potential to perform markerless tracking in low‐contrast region using a motion model.

radiology, nuclear medicine & medical imaging
Optimal Surface Marker Locations for Tumor Motion Estimation in Lung Cancer Radiotherapy

Bin Dong,Yan Jiang Graves,Xun Jia,Steve B. Jiang

DOI: https://doi.org/10.1088/0031-9155/57/24/8201

2012-04-20

Abstract:Using fiducial markers on patient's body surface to predict the tumor location is a widely used approach in lung cancer radiotherapy. The purpose of this work is to propose an algorithm that automatically identifies a sparse set of locations on the patient's surface with the optimal prediction power for the tumor motion. The sparse selection of markers on the external surface and the assumed linear relationship between the marker motion and the internal tumor motion are represented by a prediction matrix. Such a matrix is determined by solving an optimization problem, where the objective function contains a sparsity term that penalizes the number of markers chosen on the patient's surface. The performance of our algorithm has been tested on realistic clinical data of four lung cancer patients. Thoracic 4DCT scans with 10 phases are used for the study. On a reference phase, a grid of points are casted on the patient's surface (except for patient's back) and propagated to other phases via deformable image registration of the corresponding CT images. Tumor locations at each phase are also manually delineated. We use 9 out of 10 phases of the 4DCT images to identify a small group of surface markers that are most correlated with the motion of the tumor, and find the prediction matrix at the same time. The 10th phase is then used to test the accuracy of the prediction. It is found that on average 6 to 7 surface markers are necessary to predict tumor locations with a 3D error of about 1mm. In addition, the selected marker locations lie closely in those areas where surface point motion has a high correlation with the tumor motion. Our method can automatically select sparse locations on patient's external surface and estimate a correlation matrix based on 4DCT, so that the selected surface locations can be used to place fiducial markers to optimally predict internal tumor motions.

Medical Physics,Optimization and Control
Real-time liver tumor localization via a single x-ray projection using deep graph neural network-assisted biomechanical modeling

Hua-Chieh Shao,Jing Wang,Ti Bai,Jaehee Chun,Justin C Park,Steve Jiang,You Zhang

DOI: https://doi.org/10.1088/1361-6560/ac6b7b

2022-05-24

Abstract:Objective.Real-time imaging is highly desirable in image-guided radiotherapy, as it provides instantaneous knowledge of patients' anatomy and motion during treatments and enables online treatment adaptation to achieve the highest tumor targeting accuracy. Due to extremely limited acquisition time, only one or few x-ray projections can be acquired for real-time imaging, which poses a substantial challenge to localize the tumor from the scarce projections. For liver radiotherapy, such a challenge is further exacerbated by the diminished contrast between the tumor and the surrounding normal liver tissues. Here, we propose a framework combining graph neural network-based deep learning and biomechanical modeling to track liver tumor in real-time from a single onboard x-ray projection.Approach.Liver tumor tracking is achieved in two steps. First, a deep learning network is developed to predict the liver surface deformation using image features learned from the x-ray projection. Second, the intra-liver deformation is estimated through biomechanical modeling, using the liver surface deformation as the boundary condition to solve tumor motion by finite element analysis. The accuracy of the proposed framework was evaluated using a dataset of 10 patients with liver cancer.Main results.The results show accurate liver surface registration from the graph neural network-based deep learning model, which translates into accurate, fiducial-less liver tumor localization after biomechanical modeling (<1.2 (±1.2) mm average localization error).Significance.The method demonstrates its potentiality towards intra-treatment and real-time 3D liver tumor monitoring and localization. It could be applied to facilitate 4D dose accumulation, multi-leaf collimator tracking and real-time plan adaptation. The method can be adapted to other anatomical sites as well.
TH‐C‐BRC‐07: Automated Identification of Surface Marker Positions to Maximize Tumor Tracking Accuracy

B. Dong,X. Jia,Y. Graves,L. Cervino,S. Jiang

DOI: https://doi.org/10.1118/1.3613524

2011-01-01

Abstract:Purpose: Using markers at patient body surface to predict the tumor location is a widely used approach in lung cancer radiotherapy with respiratory gating. The purpose of this work is to identify a sparse set of locations on the patientˈs external surface, which are most correlated with the tumor motion and hence can be used for tumor location predication effectively. Methods: Thoracic 4DCT scans with 10 phases are used for the study. For each phase, points on external surface (except for patientˈs back) are segmented and the correspondence of the points between phases is established via deformable image registration of the corresponding CT images. It is assumed that there is a linear relationship between the selected surface points and the tumor locations. The selection of the sparse locations on external surface and the linear dependence of these points to internal tumor motion are represented by a prediction matrix. Such a matrix is determined by solving an optimization problem, where the objective function contains a sparsity term about the number of surface points chosen. Bregman iteration is used to solve the optimization problem. To test our algorithm on realistic patient cases, we first solve our problem using the 9 out of 10 phases of the 4DCT images to identify surface points that are most correlated with the tumor locations and the prediction matrix. The 10th phase is then used to test the accuracy of the prediction. Results: The method is tested on 6 patient data. The average prediction error is under 1 mm. The number of locations selected on patientˈs external surface is under 7 in average. Conclusions: Our method can automatically select sparse locations on patientˈs external surface and estimates a correlation matrix of these locations with internal tumor motions based on 4DCT.
Volumetric tumor tracking from a single cone-beam X-ray projection image enabled by deep learning

Jingjing Dai,Guoya Dong,Chulong Zhang,Wenfeng He,Lin Liu,Tangsheng Wang,Yuming Jiang,Wei Zhao,Xiang Zhao,Yaoqin Xie,Xiaokun Liang

DOI: https://doi.org/10.1016/j.media.2023.102998

IF: 10.9

2023-10-12

Medical Image Analysis

Abstract:Radiotherapy serves as a pivotal treatment modality for malignant tumors. However, the accuracy of radiotherapy is significantly compromised due to respiratory-induced fluctuations in the size, shape, and position of the tumor. To address this challenge, we introduce a deep learning-anchored, volumetric tumor tracking methodology that employs single-angle X-ray projection images. This process involves aligning the intraoperative two-dimensional (2D) X-ray images with the pre-treatment three-dimensional (3D) planning Computed Tomography (CT) scans, enabling the extraction of the 3D tumor position and segmentation. Prior to therapy, a bespoke patient-specific tumor tracking model is formulated, leveraging a hybrid data augmentation, style correction, and registration network to create a mapping from single-angle 2D X-ray images to the corresponding 3D tumors. During the treatment phase, real-time X-ray images are fed into the trained model, producing the respective 3D tumor positioning. Rigorous validation conducted on actual patient lung data and lung phantoms attests to the high localization precision of our method at lowered radiation doses, thus heralding promising strides towards enhancing the precision of radiotherapy.

engineering, biomedical,computer science, interdisciplinary applications, artificial intelligence,radiology, nuclear medicine & medical imaging
Adenosine and caffeine-induced paroxysmal supraventricular tachycardia.

Harry C. Karydes,S. Bryant

DOI: https://doi.org/10.1111/j.1553-2712.2010.00732.x

2010-05-01

Academic Emergency Medicine

Abstract:While we recog-nize their study objectives and included limitations, wefeel that the design of the study faces signiﬁcant imped-iments, namely, the proper selection of controls and thethreat of validity of results using self-reported data.Caffeine kinetics are nonlinear and the effects of thedrug are dose-dependent.

[Women's attitude to the gynecological examination].

Deep match: A zero-shot framework for improved fiducial-free respiratory motion tracking

Automated Clinical Target Volume Delineation Using Deep 3D Neural Networks in Radiation Therapy of Non-small Cell Lung Cancer

Assessment of fiducial motion in CBCT projections of the abdominal tumor using template matching and sequential stereo triangulation

MA13.01 Markerless Tumor Tracking During Lung Radiotherapy Using Intrafraction X-Ray Imaging

Simultaneous object detection and segmentation for patient-specific markerless lung tumor tracking in simulated radiographs with deep learning

Fluoroscopic Tumor Tracking for Image-Guided Lung Cancer Radiotherapy.

WE-AB-303-08: Direct Lung Tumor Tracking Using Short Imaging Arcs

Predicting successful clinical candidates for fiducial-free lung tumor tracking with a deep learning binary classification model

TU-C-214-03: Markerless Tumor Tracking Via Clustering on Low-Rank Fluoroscopic Images for Image-Guided Lung Cancer Radiotherapy

Markerless Lung Tumor Localization From Intraoperative Stereo Color Fluoroscopic Images for Radiotherapy

Markerless Tumor Tracking Using Short Kilovoltage Imaging Arcs for Lung Image-Guided Radiotherapy

A Real-Time Tracking and Visualization System for Robot-Assisted Template Location Method Applied to Lung Cancer Brachytherapy

Deep learning‐based target decomposition for markerless lung tumor tracking in radiotherapy

Automatic target positioning and tracking for image-guided radiotherapy without implanted fiducials

Markerless tracking of tumor and tissues: A motion model approach

Optimal Surface Marker Locations for Tumor Motion Estimation in Lung Cancer Radiotherapy

Real-time liver tumor localization via a single x-ray projection using deep graph neural network-assisted biomechanical modeling

TH‐C‐BRC‐07: Automated Identification of Surface Marker Positions to Maximize Tumor Tracking Accuracy

Volumetric tumor tracking from a single cone-beam X-ray projection image enabled by deep learning

Adenosine and caffeine-induced paroxysmal supraventricular tachycardia.