Cell wall invertase activity in cultured tobacco tissues

Hamako Obata-Sasamoto,T. Thorpe

DOI: https://doi.org/10.1007/BF00033546

1982-03-01

Abstract:

What problem does this paper attempt to address?

Large Language Model-Augmented Auto-Delineation of Treatment Target Volume in Radiation Therapy

Praveenbalaji Rajendran,Yong Yang,Thomas R. Niedermayr,Michael Gensheimer,Beth Beadle,Quynh-Thu Le,Lei Xing,Xianjin Dai

2024-07-10

Abstract:Radiation therapy (RT) is one of the most effective treatments for cancer, and its success relies on the accurate delineation of targets. However, target delineation is a comprehensive medical decision that currently relies purely on manual processes by human experts. Manual delineation is time-consuming, laborious, and subject to interobserver variations. Although the advancements in artificial intelligence (AI) techniques have significantly enhanced the auto-contouring of normal tissues, accurate delineation of RT target volumes remains a challenge. In this study, we propose a visual language model-based RT target volume auto-delineation network termed Radformer. The Radformer utilizes a hierarichal vision transformer as the backbone and incorporates large language models to extract text-rich features from clinical data. We introduce a visual language attention module (VLAM) for integrating visual and linguistic features for language-aware visual encoding (LAVE). The Radformer has been evaluated on a dataset comprising 2985 patients with head-and-neck cancer who underwent RT. Metrics, including the Dice similarity coefficient (DSC), intersection over union (IOU), and 95th percentile Hausdorff distance (HD95), were used to evaluate the performance of the model quantitatively. Our results demonstrate that the Radformer has superior segmentation performance compared to other state-of-the-art models, validating its potential for adoption in RT practice.

Medical Physics,Artificial Intelligence,Computer Vision and Pattern Recognition
Automated Clinical Target Volume Delineation Using Deep 3D Neural Networks in Radiation Therapy of Non-small Cell Lung Cancer

Yunhe Xie,Kongbin Kang,Yi Wang,Melin J. Khandekar,Henning Willers,Florence K. Keane,Thomas R. Bortfeld

DOI: https://doi.org/10.1016/j.phro.2021.08.003

2021-01-01

Physics and Imaging in Radiation Oncology

Abstract:Background and purpose: Clinical targeted volume (CTV) delineation accounting for the patient-specific microscopic tumor spread can be a difficult step in defining the treatment volume. We developed an intelligent and automated CTV delineation system for locally advanced non-small cell lung carcinoma (NSCLC) to cover the microscopic tumor spread while avoiding organs-at-risk (OAR). Materials and methods: A 3D UNet with a customized loss function was used, which takes both the patients' respiration-correlated ("4D") CT scan and the physician contoured internal gross target volume (iGTV) as inputs, and outputs the CTV delineation. Among the 84 identified patients, 60 were randomly selected to train the network, and the remaining as testing. The model performance was evaluated and compared with cropped expansions using the shape similarities to the physicians' contours (the ground-truth) and the avoidance of critical OARs. Results: On the testing datasets, all model-predicted CTV contours followed closely to the ground truth, and were acceptable by physicians. The average dice score was 0.86. Our model-generated contours demonstrated better agreement with the ground-truth than the cropped 5 mm/8 mm expansion method (median of median surface distance of 1.0 mm vs 1.9 mm/2.0 mm), with a small overlap volume with OARs (0.4 cm(3) for the esophagus and 1.2 cm(3) for the heart). Conclusions: The CTVs generated by our CTV delineation system agree with the physician's contours. This approach demonstrates the capability of intelligent volumetric expansions with the potential to be used in clinical practice.
Automated Clinical Target Volume Delineation for Non-Small Cell Lung Cancer Patients Using Deep 3D Networks

Y. Xie,K. Kang,Y. Wang,F. K. Keane,M. J. Khandekar,H. Willers,T. Bortfeld

DOI: https://doi.org/10.1016/j.ijrobp.2020.07.827

2020-01-01

Abstract:Patient-specific clinical target volume (CTV) delineation is the most difficult step in defining the planning target volume from the gross tumor volume. Delineating patient specific CTVs is a labor-intensive process, prone to human error, with poor inter-observer consistency. Automated volumetric expansions have been used to reduce these concerns, but these ignore patient specific anatomic and clinical variables, as well as the clinical experience of the radiation oncologist. We developed an automated CTV delineation system for lung cancer, which was trained to learn the physician’s CTV contour pattern using a deep 3D neural network. Our network took both patients’ CT images and their corresponding internal target volume (ITV) as input, and output CTV delineation. ITVs were contoured by physicians after studying the internal motion of the target from the 4D CT scans. In our study, the network was trained from twenty-five NSCLC patients in right upper lung lobe (RUL). Then, the trained network was tested on four additional datasets from RUL NSCLC patients. Each CTV delineation output by the trained network was compared with the corresponding CTV contoured by physicians. One challenge to train a 3D network for CTV delineation is the high imbalance between the CTV volume and the background volume. Instead of using hyperparameters to balance as existing methods did, we directly optimize a loss function robust to high imbalance. This improves the stability of the model, especially when the balance dynamically changes in images. Three out of four CTV contours that were automatically delineated by our trained model agree very well with the physician’s CTV contour. Only one has visible discrepancies near the apex of the upper lobe, but still looks reasonable. As shown in Table 1, the performance of the trained neural network was also quantitatively evaluated using precision and recall between the predicted CTVs and the ground truth CTVs. The average precision is 0.902, and recall is 0.871. The recall and precision are the fraction of true volume among the total ground-truth and the fraction of true volume among the predicted volume, respectively. The automated CTV delineation was utilized for RUL NSCLC patients using the deep learning method solely based on CT images with manually contoured ITV. On the limited testing samples, the model contoured CTVs reasonably well. This approach would potentially combine the ease of automated volumetric expansions while incorporating the patient specific anatomic and clinical variables along with the clinical expertise of the radiation oncologist.Tabled 1Abstract 2782; Table; A quantitative evaluation of our automated CTV delineation system on four testing patients.Test #1Test #2Test #3Test #4Recall0.9420.7270.9090.907Precision0.8150.8890.9550.950 Open table in a new tab
Qualitative and Quantitative Analysis of a Deep Learning Auto Contouring Model for Radiotherapy in Localized Prostate Cancer.

G. H. Boyd,J. A. Efstathiou,S. C. Kamran,A. L. Zietman,D. T. Miyamoto,M. C. Kirk,Y. Wang

DOI: https://doi.org/10.1016/j.ijrobp.2021.07.509

2021-01-01

Abstract:The model can accurately auto contour target volumes, OARs and spacer with meaningful to substantial efficiency gain, with a majority of target volumes qualitatively evaluated by a physician as having only mild to moderate discrepancies. Quantitative analysis shows contours for most OARs have only minor geometric differences unlikely to have significant dose-volume impacts. Further analysis with comparison of treatment plans generated from ACs and MCs is warranted.
Dosimetric Analysis of Radiation Treatment Plans Based on a Deep Learning Auto Contouring Model for Patients with Localized Prostate Cancer

G.H. Boyd,T. Nguyen,J.A. Efstathiou,S.C. Kamran,A.L. Zietman,D.T. Miyamoto,Y. Wang

DOI: https://doi.org/10.1016/j.ijrobp.2022.07.929

IF: 8.013

2022-01-01

International Journal of Radiation Oncology*Biology*Physics

Abstract:<h3>Purpose/Objective(s)</h3> To evaluate the feasibility and safety of creating radiation treatment plans based on a convolutional neural network auto-contouring (AC) model for patients receiving radiation for localized prostate cancer with a radio-opaque rectal spacer hydrogel. <h3>Materials/Methods</h3> The deep learning model produces ACs for target volumes (prostate, proximal seminal vesicle), OARs (rectum, bladder, penile bulb, femoral heads), and rectal hydrogel spacers. ACs were compared to manual contours (MC) by MDs for clinical use. Individual volumes and overall performance (composite score) were previously evaluated and reported, qualitatively using a 1 (minor discrepancy), 2 (moderate discrepancy), 3 (significant discrepancy), and 4 (rejected, gross error) scale and quantitatively using Dice Similarity Coefficient (DSC) and mean distance to agreement. VMAT treatment plans were created on unedited AC volumes from five composite 1 (C1) cases and five composite 2 (C2) cases and dose volume metrics were computed for the final MCs. Dosimetry comparison was performed to assess the safety of delivering a treatment plan created from unedited ACs. Cases were planned to 50.4 Gy in 28 fractions to the SVs, with a SIB of 70 Gy the prostate. PTV expansions were CTV+5 mm (CTV+4 mm posteriorly). <h3>Results</h3> Of 62 initial cases evaluated, 11 were scored as a C1, 28 were scored as a C2, and 23 received a C3. 10 cases were randomly selected for treatment planning. For prostate (CTV P) in selected C1 and C2 cases, mean score was 1 and 1.8 and mean DSC was 0.919 and 0.876, respectively. Clinical goals for planning and dosimetric data from treatment plans are shown in Table 1. The mean V70 Gy for prostate CTV/PTV was 99.83%/90.05% for C1 cases and 99.46%/89.15% for C2 cases. All clinical goals for OARs were met in both cohorts. <h3>Conclusion</h3> 63% of all cases evaluated received a C1 or C2 score. Our results indicate the treatment plans generated from unedited ACs on these cases respected all clinical goals for OARs. Although C1 plans produced better PTV coverage than C2, almost all plans had sub-optimal PTV coverage, indicating the need for MDs to edit target volumes before treatment planning.
Macrocyclic compounds as anti-cancer agents: design and synthesis of multi-acting inhibitors against HDAC, FLT3 and JAK2.

Chengqing Ning,Cheng Lu,Liang Hu,Yanjing Bi,Lei Yao,Yujun He,Li-fei Liu,Xiaoyu Liu,Niefang Yu

DOI: https://doi.org/10.1016/j.ejmech.2015.03.034

IF: 7.088

2015-05-05

European Journal of Medicinal Chemistry

Abstract:
LLM-driven Multimodal Target Volume Contouring in Radiation Oncology

Yujin Oh,Sangjoon Park,Hwa Kyung Byun,Yeona Cho,Ik Jae Lee,Jin Sung Kim,Jong Chul Ye

2024-04-16

Abstract:Target volume contouring for radiation therapy is considered significantly more challenging than the normal organ segmentation tasks as it necessitates the utilization of both image and text-based clinical information. Inspired by the recent advancement of large language models (LLMs) that can facilitate the integration of the textural information and images, here we present a novel LLM-driven multimodal AI, namely LLMSeg, that utilizes the clinical text information and is applicable to the challenging task of target volume contouring for radiation therapy, and validate it within the context of breast cancer radiation therapy target volume contouring. Using external validation and data-insufficient environments, which attributes highly conducive to real-world applications, we demonstrate that the proposed model exhibits markedly improved performance compared to conventional unimodal AI models, particularly exhibiting robust generalization performance and data efficiency. To our best knowledge, this is the first LLM-driven multimodal AI model that integrates the clinical text information into target volume delineation for radiation oncology.

Image and Video Processing,Computer Vision and Pattern Recognition
Artificial Intelligence-Assisted Delineation for Postoperative Radiotherapy in Patients with Lung Cancer: A Prospective, Multi-Center, Cohort Study

Ziming Han,Yu Wang,Wenqing Wang,Tao Zhang,Jianyang Wang,Xiangyu Ma,Kuo Men,Anhui Shi,Yuyan Gao,Nan Bi

DOI: https://doi.org/10.3389/fonc.2024.1388297

IF: 4.7

2024-01-01

Frontiers in Oncology

Abstract:Background:Postoperative radiotherapy (PORT) is an important treatment for lung cancer patients with poor prognostic features, but accurate delineation of the clinical target volume (CTV) and organs at risk (OARs) is challenging and time-consuming. Recently, deep learning-based artificial intelligent (AI) algorithms have shown promise in automating this process.Objective:To evaluate the clinical utility of a deep learning-based auto-segmentation model for AI-assisted delineating CTV and OARs in patients undergoing PORT, and to compare its accuracy and efficiency with manual delineation by radiation oncology residents from different levels of medical institutions.Methods:We previously developed an AI auto-segmentation model in 664 patients and validated its contouring performance in 149 patients. In this multi-center, validation trial, we prospectively involved 55 patients and compared the accuracy and efficiency of 3 contouring methods: (i) unmodified AI auto-segmentation, (ii) fully manual delineation by junior radiation oncology residents from different medical centers, and (iii) manual modifications based on AI segmentation model (AI-assisted delineation). The ground truth of CTV and OARs was delineated by 3 senior radiation oncologists. Contouring accuracy was evaluated by Dice similarity coefficient (DSC), Hausdorff distance (HD), and mean distance of agreement (MDA). Inter-observer consistency was assessed by volume and coefficient of variation (CV).Results:AI-assisted delineation achieved significantly higher accuracy compared to unmodified AI auto-contouring and fully manual delineation by radiation oncologists, with median HD, MDA, and DCS values of 20.03 vs. 21.55 mm, 2.57 vs. 3.06 mm, 0.745 vs. 0.703 (all P<0.05) for CTV, respectively. The results of OARs contours were similar. CV for OARs was reduced by approximately 50%. In addition to better contouring accuracy, the AI-assisted delineation significantly decreased the consuming time and improved the efficiency.Conclusion:AI-assisted CTV and OARs delineation for PORT significantly improves the accuracy and efficiency in the real-world setting, compared with pure AI auto-segmentation or fully manual delineation by junior oncologists. AI-assisted approach has promising clinical potential to enhance the quality of radiotherapy planning and further improve treatment outcomes of patients with lung cancer.
Deep learning promoted target volumes delineation of total marrow and total lymphoid irradiation for accelerated radiotherapy: A multi-institutional study

Xudong Xue,Jun Shi,Hui Zeng,Bing Yan,Lei Liu,Dazhen Jiang,Xiaoyong Wang,Hui Liu,Man Jiang,Jianjun Shen,Hong An,An Liu

DOI: https://doi.org/10.1016/j.ejmp.2024.103393

IF: 3.119

2024-06-09

Physica Medica

Abstract:Highlights • A neural network model was developed for segmenting target volumes of TMLI. • The local and global contextual information can be captured. • Superior accuracy and decreased delineation time can be achieved. • The model could be implemented in radiotherapy practice. Background and purpose One of the current roadblocks to the widespread use of Total Marrow Irradiation (TMI) and Total Marrow and Lymphoid Irradiation (TMLI) is the challenging difficulties in tumor target contouring workflow. This study aims to develop a hybrid neural network model that promotes accurate, automatic, and rapid segmentation of multi-class clinical target volumes. Materials and methods Patients who underwent TMI and TMLI from January 2018 to May 2022 were included. Two independent oncologists manually contoured eight target volumes for patients on CT images. A novel Dual-Encoder Alignment Network (DEA-Net) was developed and trained using 46 patients from one internal institution and independently evaluated on a total of 39 internal and external patients. Performance was evaluated on accuracy metrics and delineation time. Results The DEA-Net achieved a mean dice similarity coefficient of 90.1 % ± 1.8 % for internal testing dataset (23 patients) and 91.1 % ± 2.5 % for external testing dataset (16 patients). The 95 % Hausdorff distance and average symmetric surface distance were 2.04 ± 0.62 mm and 0.57 ± 0.11 mm for internal testing dataset, and 2.17 ± 0.68 mm, and 0.57 ± 0.20 mm for external testing dataset, respectively, outperforming most of existing state-of-the-art methods. In addition, the automatic segmentation workflow reduced delineation time by 98 % compared to the conventional manual contouring process (mean 173 ± 29 s vs. 12168 ± 1690 s; P < 0.001). Ablation study validate the effectiveness of hybrid structures. Conclusion The proposed deep learning framework achieved comparable or superior target volume delineation accuracy, significantly accelerating the radiotherapy planning process.

radiology, nuclear medicine & medical imaging
Multi-Task Learning for Integrated Automated Contouring and Voxel-Based Dose Prediction in Radiotherapy

Sangwook Kim,Aly Khalifa,Thomas G. Purdie,Chris McIntosh

2024-11-28

Abstract:Deep learning-based automated contouring and treatment planning has been proven to improve the efficiency and accuracy of radiotherapy. However, conventional radiotherapy treatment planning process has the automated contouring and treatment planning as separate tasks. Moreover in deep learning (DL), the contouring and dose prediction tasks for automated treatment planning are done independently. In this study, we applied the multi-task learning (MTL) approach in order to seamlessly integrate automated contouring and voxel-based dose prediction tasks, as MTL can leverage common information between the two tasks and be able able to increase the efficiency of the automated tasks. We developed our MTL framework using the two datasets: in-house prostate cancer dataset and the publicly available head and neck cancer dataset, OpenKBP. Compared to the sequential DL contouring and treatment planning tasks, our proposed method using MTL improved the mean absolute difference of dose volume histogram metrics of prostate and head and neck sites by 19.82% and 16.33%, respectively. Our MTL model for automated contouring and dose prediction tasks demonstrated enhanced dose prediction performance while maintaining or sometimes even improving the contouring accuracy. Compared to the baseline automated contouring model with the dice score coefficients of 0.818 for prostate and 0.674 for head and neck datasets, our MTL approach achieved average scores of 0.824 and 0.716 for these datasets, respectively. Our study highlights the potential of the proposed automated contouring and planning using MTL to support the development of efficient and accurate automated treatment planning for radiotherapy.

Medical Physics,Computer Vision and Pattern Recognition,Machine Learning
Large‐language‐model empowered 3D dose prediction for intensity‐modulated radiotherapy

Zehao Dong,Yixin Chen,Hiram Gay,Yao Hao,Geoffrey D. Hugo,Pamela Samson,Tianyu Zhao

DOI: https://doi.org/10.1002/mp.17416

IF: 4.506

2024-09-26

Medical Physics

Abstract:Background Treatment planning is currently a patient specific, time‐consuming, and resource demanding task in radiotherapy. Dose‐volume histogram (DVH) prediction plays a critical role in automating this process. The geometric relationship between DVHs in radiotherapy plans and organs‐at‐risk (OAR) and planning target volume (PTV) has been well established. This study explores the potential of deep learning models for predicting DVHs using images and subsequent human intervention facilitated by a large‐language model (LLM) to enhance the planning quality. Method We propose a pipeline to convert unstructured images to a structured graph consisting of image‐patch nodes and dose nodes. A novel Dose Graph Neural Network (DoseGNN) model is developed for predicting DVHs from the structured graph. The proposed DoseGNN is enhanced with the LLM to encode massive knowledge from prescriptions and interactive instructions from clinicians. In this study, we introduced an online human‐AI collaboration (OHAC) system as a practical implementation of the concept proposed for the automation of intensity‐modulated radiotherapy (IMRT) planning. Results The proposed DoseGNN model was compared to widely employed DL models used in radiotherapy, including Swin Transformer, 3D U‐Net CNN, and vanilla MLP. For PTV, DoseGNN achieved the mean absolute error (MAE) of Dmax , Dmean , D95 , and D1 between true plans and predicted plans that were 64%, 53%, 64%, 61% of the best baseline model. For the worst case among OARs (left lung, right lung, chest wall, heart, spinal cord), DoseGNN achieved the mean absolute error of Dmax , Dmean , D50 that were 85%, 91%, 80% of the best baseline model. Moreover, the LLM‐empowered DoseGNN model facilitates seamless adjustment to treatment plans through interaction with clinicians using natural language. Conclusion We developed DoseGNN, a novel deep learning model for predicting delivered radiation doses from medical images, enhanced by LLM to allow adjustment through seamless interaction with clinicians. The preliminary results confirm DoseGNN's superior accuracy in DVH prediction relative to typical DL methods, highlighting its potential to facilitate an online clinician‐AI collaboration system for streamlined treatment planning automation.

radiology, nuclear medicine & medical imaging
Technical note: Generalizable and promptable artificial intelligence model to augment clinical delineation in radiation oncology

Lian Zhang,Zhengliang Liu,Lu Zhang,Zihao Wu,Xiaowei Yu,Jason Holmes,Hongying Feng,Haixing Dai,Xiang Li,Quanzheng Li,William W. Wong,Sujay A. Vora,Dajiang Zhu,Tianming Liu,Wei Liu

DOI: https://doi.org/10.1002/mp.16965

IF: 4.506

2024-02-08

Medical Physics

Abstract:Background Efficient and accurate delineation of organs at risk (OARs) is a critical procedure for treatment planning and dose evaluation. Deep learning‐based auto‐segmentation of OARs has shown promising results and is increasingly being used in radiation therapy. However, existing deep learning‐based auto‐segmentation approaches face two challenges in clinical practice: generalizability and human‐AI interaction. A generalizable and promptable auto‐segmentation model, which segments OARs of multiple disease sites simultaneously and supports on‐the‐fly human‐AI interaction, can significantly enhance the efficiency of radiation therapy treatment planning. Purpose Meta's segment anything model (SAM) was proposed as a generalizable and promptable model for next‐generation natural image segmentation. We further evaluated the performance of SAM in radiotherapy segmentation. Methods Computed tomography (CT) images of clinical cases from four disease sites at our institute were collected: prostate, lung, gastrointestinal, and head & neck. For each case, we selected the OARs important in radiotherapy treatment planning. We then compared both the Dice coefficients and Jaccard indices derived from three distinct methods: manual delineation (ground truth), automatic segmentation using SAM's 'segment anything' mode, and automatic segmentation using SAM's 'box prompt' mode that implements manual interaction via live prompts during segmentation. Results Our results indicate that SAM's segment anything mode can achieve clinically acceptable segmentation results in most OARs with Dice scores higher than 0.7. SAM's box prompt mode further improves Dice scores by 0.1∼0.5. Similar results were observed for Jaccard indices. The results show that SAM performs better for prostate and lung, but worse for gastrointestinal and head & neck. When considering the size of organs and the distinctiveness of their boundaries, SAM shows better performance for large organs with distinct boundaries, such as lung and liver, and worse for smaller organs with less distinct boundaries, like parotid and cochlea. Conclusions Our results demonstrate SAM's robust generalizability with consistent accuracy in automatic segmentation for radiotherapy. Furthermore, the advanced box‐prompt method enables the users to augment auto‐segmentation interactively and dynamically, leading to patient‐specific auto‐segmentation in radiation therapy. SAM's generalizability across different disease sites and different modalities makes it feasible to develop a generic auto‐segmentation model in radiotherapy.

radiology, nuclear medicine & medical imaging
Mixture of Multicenter Experts in Multimodal Generative AI for Advanced Radiotherapy Target Delineation

Yujin Oh,Sangjoon Park,Xiang Li,Wang Yi,Jonathan Paly,Jason Efstathiou,Annie Chan,Jun Won Kim,Hwa Kyung Byun,Ik Jae Lee,Jaeho Cho,Chan Woo Wee,Peng Shu,Peilong Wang,Nathan Yu,Jason Holmes,Jong Chul Ye,Quanzheng Li,Wei Liu,Woong Sub Koom,Jin Sung Kim,Kyungsang Kim

2024-10-26

Abstract:Clinical experts employ diverse philosophies and strategies in patient care, influenced by regional patient populations. However, existing medical artificial intelligence (AI) models are often trained on data distributions that disproportionately reflect highly prevalent patterns, reinforcing biases and overlooking the diverse expertise of clinicians. To overcome this limitation, we introduce the Mixture of Multicenter Experts (MoME) approach. This method strategically integrates specialized expertise from diverse clinical strategies, enhancing the AI model's ability to generalize and adapt across multiple medical centers. The MoME-based multimodal target volume delineation model, trained with few-shot samples including images and clinical notes from each medical center, outperformed baseline methods in prostate cancer radiotherapy target delineation. The advantages of MoME were most pronounced when data characteristics varied across centers or when data availability was limited, demonstrating its potential for broader clinical applications. Therefore, the MoME framework enables the deployment of AI-based target volume delineation models in resource-constrained medical facilities by adapting to specific preferences of each medical center only using a few sample data, without the need for data sharing between institutions. Expanding the number of multicenter experts within the MoME framework will significantly enhance the generalizability, while also improving the usability and adaptability of clinical AI applications in the field of precision radiation oncology.

Image and Video Processing,Computer Vision and Pattern Recognition,Machine Learning
A deep learning-based framework for segmenting invisible clinical target volumes with estimated uncertainties for post-operative prostate cancer radiotherapy

Anjali Balagopal,Dan Nguyen,Howard Morgan,Yaochung Weng,Michael Dohopolski,Mu-Han Lin,Azar Sadeghnejad Barkousaraie,Yesenia Gonzalez,Aurelie Garant,Neil Desai,Raquibul Hannan,Steve Jiang

DOI: https://doi.org/10.48550/arXiv.2004.13294

2020-04-28

Abstract:In post-operative radiotherapy for prostate cancer, the cancerous prostate gland has been surgically removed, so the clinical target volume (CTV) to be irradiated encompasses the microscopic spread of tumor cells, which cannot be visualized in typical clinical images such as computed tomography or magnetic resonance imaging. In current clinical practice, physicians segment CTVs manually based on their relationship with nearby organs and other clinical information, per clinical guidelines. Automating post-operative prostate CTV segmentation with traditional image segmentation methods has been a major challenge. Here, we propose a deep learning model to overcome this problem by segmenting nearby organs first, then using their relationship with the CTV to assist CTV segmentation. The model proposed is trained using labels clinically approved and used for patient treatment, which are subject to relatively large inter-physician variations due to the absence of a visual ground truth. The model achieves an average Dice similarity coefficient (DSC) of 0.87 on a holdout dataset of 50 patients, much better than established methods, such as atlas-based methods (DSC<0.7). The uncertainties associated with automatically segmented CTV contours are also estimated to help physicians inspect and revise the contours, especially in areas with large inter-physician variations. We also use a 4-point grading system to show that the clinical quality of the automatically segmented CTV contours is equal to that of approved clinical contours manually drawn by physicians.

Image and Video Processing,Machine Learning,Medical Physics
Deep learning based clinical target volumes contouring for prostate cancer: Easy and efficient application

Feng Wen,Zhebin Chen,Xin Wang,Meng Dou,Jialuo Yang,Yu Yao,Yali Shen

DOI: https://doi.org/10.1002/acm2.14482

Abstract:Background: Radiotherapy has been crucial in prostate cancer treatment. However, manual segmentation is labor intensive and highly variable among radiation oncologists. In this study, a deep learning based automated contouring model is constructed for clinical target volumes (CTVs) of intact and postoperative prostate cancer. Methods: Computed tomography (CT) data sets of 197 prostate cancer patients were collected. Two auto-delineation models were built for radical radiotherapy and postoperative radiotherapy of prostate cancer respectively, and each model included CTVn for pelvic lymph nodes and CTVp for prostate tumors or prostate tumor beds. Results: In the radical radiotherapy model, the volumetric dice (VD) coefficient of CTVn calculated by AI, was higher than that of the one delineated by the junior physicians (0.85 vs. 0.82, p = 0.018); In the postoperative radiotherapy model, the quantitative parameter of CTVn and CTVp, counted by AI, was better than that of the junior physicians. The median delineation time for AI was 0.23 min in the postoperative model and 0.26 min in the radical model, which were significantly shorter than those of the physicians (50.40 and 45.43 min, respectively, p < 0.001). The correction time of the senior physician for AI was much shorter compared with that for the junior physicians in both models (p < 0.001). Conclusion: Using deep learning and attention mechanism, a highly consistent and time-saving contouring model was built for CTVs of pelvic lymph nodes and prostate tumors or prostate tumor beds for prostate cancer, which also might be a good approach to train junior radiation oncologists.
Automatic delineation of cervical cancer target volumes in small samples based on multi-decoder and semi-supervised learning and clinical application

Haibo Peng,Tao Liu,Pengcheng Li,Fang Yang,Xing Luo,Xiaoqing Sun,Dong Gao,Fengyu Lin,Lecheng Jia,Ningyue Xu,Huigang Tan,Xi Wang,Tao Ren

DOI: https://doi.org/10.1038/s41598-024-78424-0

IF: 4.6

2024-11-08

Scientific Reports

Abstract:Radiotherapy has been demonstrated to be one of the most significant treatments for cervical cancer, during which accurate and efficient delineation of target volumes is critical. To alleviate the data demand of deep learning and promote the establishment and promotion of auto-segmentation models in small and medium-sized oncology departments and single centres, we proposed an auto-segmentation algorithm to determine the cervical cancer target volume in small samples based on multi-decoder and semi-supervised learning (MDSSL), and we evaluated the accuracy via an independent test cohort. In this study, we retrospectively collected computed tomography (CT) datasets from 71 pelvic cervical cancer patients, and a 3:4 ratio was used for the training and testing sets. The clinical target volumes (CTVs) of the primary tumour area (CTV1) and pelvic lymph drainage area (CTV2) were delineated. For definitive radiotherapy (dRT), the primary gross target volume (GTVp) was simultaneously delineated. According to the data characteristics for small samples, the MDSSL network structure based on 3D U-Net was established to train the model by combining clinical anatomical information, which was compared with other segmentation methods, including supervised learning (SL) and transfer learning (TL). The dice similarity coefficient (DSC), 95% Hausdorff distance (HD95) and average surface distance (ASD) were used to evaluate the segmentation performance. The ability of the segmentation algorithm to improve the efficiency of online adaptive radiation therapy (ART) was assessed via geometric indicators and a subjective evaluation of radiation oncologists (ROs) in prospective clinical applications. Compared with the SL model and TL model, the proposed MDSSL model displayed the best DSC, HD95 and ASD overall, especially for the GTVp of dRT. We calculated the above geometric indicators in the range of the ground truth (head-foot direction). In the test set, the DSC, HD95 and ASD of the MDSSL model were 0.80/5.85 mm/0.95 mm for CTV1 of post-operative radiotherapy (pRT), 0.84/ 4.88 mm/0.73 mm for CTV2 of pRT, 0.84/6.58 mm/0.89 mm for GTVp of dRT, 0.85/5.36 mm/1.35 mm for CTV1 of dRT, and 0.84/4.09 mm/0.73 mm for CTV2 of dRT, respectively. In a prospective clinical study of online ART, the target volume modification time (MTime) was 3–5 min for dRT and 2–4 min for pRT, and the main duration of CTV1 modification was approximately 2 min. The introduction of the MDSSL method successfully improved the accuracy of auto-segmentation for the cervical cancer target volume in small samples, showed good consistency with RO delineation and satisfied clinical requirements. In this prospective online ART study, the application of the segmentation model was demonstrated to be useful for reducing the target volume delineation time and improving the efficiency of the online ART workflow, which can contribute to the development and promotion of cervical cancer online ART.

multidisciplinary sciences
A Survey on Automatic Delineation of Radiotherapy Target Volume based on Machine Learning

Zhenchao Tao,Shengfei Lyu

DOI: https://doi.org/10.1162/dint_a_00204

2023-02-11

Data Intelligence

Abstract:Abstract Radiotherapy is one of the main treatment methods for cancer, and the delineation of the radiotherapy target area is the basis and premise of precise treatment. Artificial intelligence technology represented by machine learning has done a lot of research in this area, improving the accuracy and efficiency of target delineation. This article will review the applications and research of machine learning in medical image matching, normal organ delineation and treatment target delineation according to the procudures of doctors to delineate the target volume, and give an outlook on the development prospects.

computer science, information systems
Large-Language-Model Empowered Dose Volume Histogram Prediction for Intensity Modulated Radiotherapy

Zehao Dong, Yixin Chen, Hiram Gay, Yao Hao, Geoffrey D. Hugo, Pamela Samson, Tianyu Zhao

2024-02-12

Abstract:Treatment planning is currently a patient specific, time-consuming, and resource demanding task in radiotherapy. Dose-volume histogram (DVH) prediction plays a critical role in automating this process. The geometric relationship between DVHs in radiotherapy plans and organs-at-risk (OAR) and planning target volume (PTV) has been well established. This study explores the potential of deep learning models for predicting DVHs using images and subsequent human intervention facilitated by a large-language model (LLM) to enhance the planning quality. We propose a pipeline to convert unstructured images to a structured graph consisting of image-patch nodes and dose nodes. A novel Dose Graph Neural Network (DoseGNN) model is developed for predicting DVHs from the structured graph. The proposed DoseGNN is enhanced with the LLM to encode massive knowledge from prescriptions and interactive instructions from clinicians. In this study, we introduced an online human-AI collaboration (OHAC) system as a practical implementation of the concept proposed for the automation of intensity-modulated radiotherapy (IMRT) planning. In comparison to the widely-employed DL models used in radiotherapy, DoseGNN achieved mean square errors that were 80$\%$, 76$\%$ and 41.0$\%$ of those predicted by Swin U-Net Transformer, 3D U-Net CNN and vanilla MLP, respectively. Moreover, the LLM-empowered DoseGNN model facilitates seamless adjustment to treatment plans through interaction with clinicians using natural language.

Artificial Intelligence

Cell wall invertase activity in cultured tobacco tissues

Large Language Model-Augmented Auto-Delineation of Treatment Target Volume in Radiation Therapy

Automated Clinical Target Volume Delineation Using Deep 3D Neural Networks in Radiation Therapy of Non-small Cell Lung Cancer

Automated Clinical Target Volume Delineation for Non-Small Cell Lung Cancer Patients Using Deep 3D Networks

Qualitative and Quantitative Analysis of a Deep Learning Auto Contouring Model for Radiotherapy in Localized Prostate Cancer.

Dosimetric Analysis of Radiation Treatment Plans Based on a Deep Learning Auto Contouring Model for Patients with Localized Prostate Cancer

Macrocyclic compounds as anti-cancer agents: design and synthesis of multi-acting inhibitors against HDAC, FLT3 and JAK2.

LLM-driven Multimodal Target Volume Contouring in Radiation Oncology

Artificial Intelligence-Assisted Delineation for Postoperative Radiotherapy in Patients with Lung Cancer: A Prospective, Multi-Center, Cohort Study

Deep learning promoted target volumes delineation of total marrow and total lymphoid irradiation for accelerated radiotherapy: A multi-institutional study

Multi-Task Learning for Integrated Automated Contouring and Voxel-Based Dose Prediction in Radiotherapy

Large‐language‐model empowered 3D dose prediction for intensity‐modulated radiotherapy

Technical note: Generalizable and promptable artificial intelligence model to augment clinical delineation in radiation oncology

Mixture of Multicenter Experts in Multimodal Generative AI for Advanced Radiotherapy Target Delineation

A deep learning-based framework for segmenting invisible clinical target volumes with estimated uncertainties for post-operative prostate cancer radiotherapy

Deep learning based clinical target volumes contouring for prostate cancer: Easy and efficient application

Automatic delineation of cervical cancer target volumes in small samples based on multi-decoder and semi-supervised learning and clinical application

A Survey on Automatic Delineation of Radiotherapy Target Volume based on Machine Learning

Large-Language-Model Empowered Dose Volume Histogram Prediction for Intensity Modulated Radiotherapy