Acquisition and Fuzzy Processing of Physiological Signals to Obtain Human Stress Level Using Low Cost Portable Hardware

Unai Zalabarria,Eloy Irigoyen,Raquel Martínez,Javier Arechalde

DOI: https://doi.org/10.1007/978-3-319-67180-2_7

2017-09-06

Abstract:

What problem does this paper attempt to address?

[Exploration on an Ultrasonographic Imaging Reporting and Data System in Malignancy Grading of Thyroid Nodules].

Chen Yang,Chun Han,Li-ping Wang,Na Feng,Yi-fan Wang,Xiang-dong You

DOI: https://doi.org/10.3760/cma.j.issn.0253-3766.2013.10.009

2013-01-01

Abstract:OBJECTIVE:To explore the values of ultrasonographic features in differentially diagnosing benign and malignant thyroid nodules, and attempt to establish a quantitative ultrasound classification system. METHODS:We retrospectively analyzed 20 ultrasound features of 926 thyroid nodules in 527 patients. Using logistic regression analysis, we obtained the probability function for predicting the malignancy in thyroid nodules and established a preliminary ultrasound classification system. RESULTS:The ages of patients with thyroid nodules was older than that of the patients with thyroid carcinoma (t = 6.496, P < 0.001). The correctness rate of ultrasonic diagnosis was 80.1%. The logistic multivariate regression analysis showed that among all ultrasonographic features, aspect ratio ≥ 1, obscure boundary, irregular margin, significant internal hypoecho, internal hypoecho, internal micro-calcifications, posterior echo attenuation, thyroid capsule invasion, abnormal adjacent lymph nodes, and ultrasonic elastography 5-point evaluation scores > 3 were contributing factors for thyroid carcinoma. The equation was P (us) = 1 /[1+e(-)Z], where z is the logit of malignant thyroid nodule, and taking P (us) > 0.50 as boundary value, the prediction accuracy rate was 84.1%. Using this model, 92.2% of the thyroid nodules were predicted as nodular goiter, and 69.4% of the thyroid carcinomas were correctly predicted. P (us) was stratified into four levels: Level 1: 0-16% malignancy; Level 2: 17%-50% malignancy; Level 3: 51%-70% malignancy; and level 4: 71%-100% malignancy. CONCLUSIONS:The quantitative thyroid imaging reporting and data system developed in this study makes ultrasound reports more objective, normalized and standardized. It can be used to evaluate the malignancy risk of thyroid nodules and help to make right decision in clinics.
Extracting Thyroid Nodules Characteristics from Ultrasound Reports Using Transformer-based Natural Language Processing Methods

Aman Pathak,Zehao Yu,Daniel Paredes,Elio Paul Monsour,Andrea Ortiz Rocha,Juan P. Brito,Naykky Singh Ospina,Yonghui Wu

2023-04-01

Abstract:The ultrasound characteristics of thyroid nodules guide the evaluation of thyroid cancer in patients with thyroid nodules. However, the characteristics of thyroid nodules are often documented in clinical narratives such as ultrasound reports. Previous studies have examined natural language processing (NLP) methods in extracting a limited number of characteristics (<9) using rule-based NLP systems. In this study, a multidisciplinary team of NLP experts and thyroid specialists, identified thyroid nodule characteristics that are important for clinical care, composed annotation guidelines, developed a corpus, and compared 5 state-of-the-art transformer-based NLP methods, including BERT, RoBERTa, LongFormer, DeBERTa, and GatorTron, for extraction of thyroid nodule characteristics from ultrasound reports. Our GatorTron model, a transformer-based large language model trained using over 90 billion words of text, achieved the best strict and lenient F1-score of 0.8851 and 0.9495 for the extraction of a total number of 16 thyroid nodule characteristics, and 0.9321 for linking characteristics to nodules, outperforming other clinical transformer models. To the best of our knowledge, this is the first study to systematically categorize and apply transformer-based NLP models to extract a large number of clinical relevant thyroid nodule characteristics from ultrasound reports. This study lays ground for assessing the documentation quality of thyroid ultrasound reports and examining outcomes of patients with thyroid nodules using electronic health records.

Computation and Language
A Systematic Review of Natural Language Processing Methods and Applications in Thyroidology

Ricardo Loor-Torres,Mayra Duran,David Toro-Tobon,Maria Mateo Chavez,Oscar Ponce,Cristian Soto Jacome,Danny Segura Torres,Sandra Algarin Perneth,Victor Montori,Elizabeth Golembiewski,Mariana Borras Osorio,Jungwei W Fan,Naykky Singh Ospina,Yonghui Wu,Juan P Brito

DOI: https://doi.org/10.1016/j.mcpdig.2024.03.007

Abstract:This study aimed to review the application of natural language processing (NLP) in thyroid-related conditions and to summarize current challenges and potential future directions. We performed a systematic search of databases for studies describing NLP applications in thyroid conditions published in English between January 1, 2012 and November 4, 2022. In addition, we used a snowballing technique to identify studies missed in the initial search or published after our search timeline until April 1, 2023. For included studies, we extracted the NLP method (eg, rule-based, machine learning, deep learning, or hybrid), NLP application (eg, identification, classification, and automation), thyroid condition (eg, thyroid cancer, thyroid nodule, and functional or autoimmune disease), data source (eg, electronic health records, health forums, medical literature databases, or genomic databases), performance metrics, and stages of development. We identified 24 eligible NLP studies focusing on thyroid-related conditions. Deep learning-based methods were the most common (38%), followed by rule-based (21%), and traditional machine learning (21%) methods. Thyroid nodules (54%) and thyroid cancer (29%) were the primary conditions under investigation. Electronic health records were the dominant data source (17/24, 71%), with imaging reports being the most frequently used (15/17, 88%). There is increasing interest in NLP applications for thyroid-related studies, mostly addressing thyroid nodules and using deep learning-based methodologies with limited external validation. However, none of the reviewed NLP applications have reached clinical practice. Several limitations, including inconsistent clinical documentation and model portability, need to be addressed to promote the evaluation and implementation of NLP applications to support patient care in thyroidology.
Use of natural language processing to extract and classify papillary thyroid cancer features from surgical pathology reports

Ricardo Loor-Torres,Yuqi Wu,Esteban Cabezas,Mariana Borras,David Toro-Tobon,Mayra Duran,Misk Al Zahidy,Maria Mateo Chavez,Cristian Soto Jacome,Jungwei W. Fan,Naykky M. Singh Ospina,Yonghui Wu,Juan P. Brito

2024-05-23

Abstract:Background We aim to use Natural Language Processing (NLP) to automate the extraction and classification of thyroid cancer risk factors from pathology reports. Methods We analyzed 1,410 surgical pathology reports from adult papillary thyroid cancer patients at Mayo Clinic, Rochester, MN, from 2010 to 2019. Structured and non-structured reports were used to create a consensus-based ground truth dictionary and categorized them into modified recurrence risk levels. Non-structured reports were narrative, while structured reports followed standardized formats. We then developed ThyroPath, a rule-based NLP pipeline, to extract and classify thyroid cancer features into risk categories. Training involved 225 reports (150 structured, 75 unstructured), with testing on 170 reports (120 structured, 50 unstructured) for evaluation. The pipeline's performance was assessed using both strict and lenient criteria for accuracy, precision, recall, and F1-score. Results In extraction tasks, ThyroPath achieved overall strict F-1 scores of 93% for structured reports and 90 for unstructured reports, covering 18 thyroid cancer pathology features. In classification tasks, ThyroPath-extracted information demonstrated an overall accuracy of 93% in categorizing reports based on their corresponding guideline-based risk of recurrence: 76.9% for high-risk, 86.8% for intermediate risk, and 100% for both low and very low-risk cases. However, ThyroPath achieved 100% accuracy across all thyroid cancer risk categories with human-extracted pathology information. Conclusions ThyroPath shows promise in automating the extraction and risk recurrence classification of thyroid pathology reports at large scale. It offers a solution to laborious manual reviews and advancing virtual registries. However, it requires further validation before implementation.

Computation and Language
A Preliminary Study of Extracting Pulmonary Nodules and Nodule Characteristics from Radiology Reports Using Natural Language Processing

Shuang Yang,Xi Yang,Tianchen Lyu,Xing He,Dejana Braithwaite,Hiren J. Mehta,Yi Guo,Yonghui Wu,Jiang Bian

DOI: https://doi.org/10.1109/ichi54592.2022.00125

2022-01-01

Abstract:This study aims to develop a natural language processing (NLP) tool to extract the pulmonary nodules and nodule characteristics information from free-text clinical narratives. We identified a cohort of 3,080 patients who received low dose computed tomography (LDCT) at the University of Florida health system and collected their clinical narratives including radiology reports in their electronic health records (EHRs). Then, we manually annotated 394 reports as the gold-standard corpus and explored three state-of-the-art transformer-based NLP methods. The best model achieved an F1-score of 0.9279.
Thyroid Nodule Detection and Region Estimation in Ultrasound Images: A Comparison between Physicians and an Automated Decision Support System Approach

Elmer Jeto Gomes Ataide,Mathews S. Jabaraj,Simone Schenke,Manuela Petersen,Sarvar Haghghi,Jan Wuestemann,Alfredo Illanes,Michael Friebe,Michael C. Kreissl

DOI: https://doi.org/10.3390/diagnostics13182873

IF: 3.6

2023-09-08

Diagnostics

Abstract:Background: Thyroid nodules are very common. In most cases, they are benign, but they can be malignant in a low percentage of cases. The accurate assessment of these nodules is critical to choosing the next diagnostic steps and potential treatment. Ultrasound (US) imaging, the primary modality for assessing these nodules, can lack objectivity due to varying expertise among physicians. This leads to observer variability, potentially affecting patient outcomes. Purpose: This study aims to assess the potential of a Decision Support System (DSS) in reducing these variabilities for thyroid nodule detection and region estimation using US images, particularly in lesser experienced physicians. Methods: Three physicians with varying levels of experience evaluated thyroid nodules on US images, focusing on nodule detection and estimating cystic and solid regions. The outcomes were compared to those obtained from a DSS for comparison. Metrics such as classification match percentage and variance percentage were used to quantify differences. Results: Notable disparities exist between physician evaluations and the DSS assessments: the overall classification match percentage was just 19.2%. Individually, Physicians 1, 2, and 3 had match percentages of 57.6%, 42.3%, and 46.1% with the DSS, respectively. Variances in assessments highlight the subjectivity and observer variability based on physician experience levels. Conclusions: The evident variability among physician evaluations underscores the need for supplementary decision-making tools. Given its consistency, the CAD offers potential as a reliable "second opinion" tool, minimizing human-induced variabilities in the critical diagnostic process of thyroid nodules using US images. Future integration of such systems could bolster diagnostic precision and improve patient outcomes.

medicine, general & internal
Natural Language Processing to Identify Abnormal Breast, Lung, and Cervical Cancer Screening Test Results from Unstructured Reports to Support Timely Follow-up.

Courtney J Diamond,John Laurentiev,Jie Yang,Amy Wint,Kimberly A Harris,Tin H Dang,Amrita Mecker,Emily B Carpenter,Anna N Tosteson,Adam Wright,Jennifer S Haas,Steven J Atlas,Li Zhou

DOI: https://doi.org/10.3233/shti220112

2022-01-01

Abstract:Cancer screening and timely follow-up of abnormal results can reduce mortality. One barrier to follow-up is the failure to identify abnormal results. While EHRs have coded results for certain tests, cancer screening results are often stored in free-text reports, which limit capabilities for automated decision support. As part of the multilevel Follow-up of Cancer Screening (mFOCUS) trial, we developed and implemented a natural language processing (NLP) tool to assist with real-time detection of abnormal cancer screening test results (including mammograms, low-dose chest CT scans, and Pap smears) and identification of gynecological follow-up for higher risk abnormalities (i.e. colposcopy) from free-text reports. We demonstrate the integration and implementation of NLP, within the mFOCUS system, to improve the follow-up of abnormal cancer screening results in a large integrated healthcare system. The NLP pipelines have detected scenarios when guideline-recommended care was not delivered, in part because the provider mis-identified the text-based result reports.
Natural language processing for abstraction of cancer treatment toxicities: accuracy versus human experts

Julian C Hong,Andrew T Fairchild,Jarred P Tanksley,Manisha Palta,Jessica D Tenenbaum

DOI: https://doi.org/10.1093/jamiaopen/ooaa064

2020-12-05

JAMIA Open

Abstract:Objectives: Expert abstraction of acute toxicities is critical in oncology research but is labor-intensive and variable. We assessed the accuracy of a natural language processing (NLP) pipeline to extract symptoms from clinical notes compared to physicians. Materials and methods: Two independent reviewers identified present and negated National Cancer Institute Common Terminology Criteria for Adverse Events (CTCAE) v5.0 symptoms from 100 randomly selected notes for on-treatment visits during radiation therapy with adjudication by a third reviewer. A NLP pipeline based on Apache clinical Text Analysis Knowledge Extraction System was developed and used to extract CTCAE terms. Accuracy was assessed by precision, recall, and F1. Results: The NLP pipeline demonstrated high accuracy for common physician-abstracted symptoms, such as radiation dermatitis (F1 0.88), fatigue (0.85), and nausea (0.88). NLP had poor sensitivity for negated symptoms. Conclusion: NLP accurately detects a subset of documented present CTCAE symptoms, though is limited for negated symptoms. It may facilitate strategies to more consistently identify toxicities during cancer therapy.
Implementing engineering education on the WWW: 3 case studies

C. Gale,J. Bourne,M. Dawant,D. Quinn

Abstract:
Natural Language Processing Technologies in Radiology Research and Clinical Applications.

Tianrun Cai,Andreas A Giannopoulos,Sheng Yu,Tatiana Kelil,Beth Ripley,Kanako K Kumamaru,Frank J Rybicki,Dimitrios Mitsouras

DOI: https://doi.org/10.1148/rg.2016150080

2016-01-01

Abstract:The migration of imaging reports to electronic medical record systems holds great potential in terms of advancing radiology research and practice by leveraging the large volume of data continuously being updated, integrated, and shared. However, there are significant challenges as well, largely due to the heterogeneity of how these data are formatted. Indeed, although there is movement toward structured reporting in radiology (ie, hierarchically itemized reporting with use of standardized terminology), the majority of radiology reports remain unstructured and use free-form language. To effectively "mine" these large datasets for hypothesis testing, a robust strategy for extracting the necessary information is needed. Manual extraction of information is a time-consuming and often unmanageable task. "Intelligent" search engines that instead rely on natural language processing (NLP), a computer-based approach to analyzing free-form text or speech, can be used to automate this data mining task. The overall goal of NLP is to translate natural human language into a structured format (ie, a fixed collection of elements), each with a standardized set of choices for its value, that is easily manipulated by computer programs to (among other things) order into subcategories or query for the presence or absence of a finding. The authors review the fundamentals of NLP and describe various techniques that constitute NLP in radiology, along with some key applications.
ARTIFICIAL INTELLIGENCE: NATURAL LANGUAGE PROCESSING FOR PEER-REVIEW IN RADIOLOGY

S. P. Morozov,A. V. Vladzimirskiy,V. A. Gombolevskiy,E. S. Kuz’mina,N. V. Ledikhova

DOI: https://doi.org/10.20862/0042-4676-2018-99-5-253-258

2018-12-01

Journal of radiology and nuclear medicine

Abstract:Objective. To assess the importance of natural language processing (NLP) system for quality assurance of the radiological reports. Material and methods. Multilateral analysis of chest low-dose computed tomography (LDCT) reports based on a commercially available cognitive NLP system was performed. The applicability of artificial intelligence for discrepancy identification in the report body and conclusion (quantitative analysis) and radiologist adherence to the Lung-RADS guidelines (qualitative analysis) was evaluated. Results. Quantitative analysis: in the 8.3% of cases LDCT reports contained discrepancies between text body and conclusion, i.e., lung nodule described only in body or conclusion. It carries potential risks and should be taken into account when performing a radiological study audit. Qualitative analysis: for the Lung-RADS 3 nodules, the recommended principles of patient management were used in 46%, for Lung-RADS 4A – in 42%, and for Lung-RADS 4B – in 49% of cases. Conclusion. The consistency of NLP system within the framework of radiological study audit was 95–96%. The system is applicable for the radiological study audit, i.e. large-scale automated analysis of radiological reports and other medical documents.
Multiparametric ultrasound evaluation of thyroid nodules

Vito Cantisani,Jörg Bojunga,Cosimo Durante,Vincenzo Dolcetti,Patrizia Pacini

DOI: https://doi.org/10.1055/a-2329-2866

2024-09-06

Abstract:Thyroid nodules are common incidental findings. Most of them are benign, but many unnecessary fine-needle aspiration procedures, core biopsies, and even thyroidectomies or non-invasive treatments have been performed. To improve thyroid nodule characterization, the use of multiparametric ultrasound evaluation has been encouraged by most experts and several societies. In particular, US elastography for assessing tissue stiffness and CEUS for providing insight into vascularization contribute to improved characterization. Moreover, the application of AI, particularly machine learning and deep learning, enhances diagnostic accuracy. Furthermore, AI-based computer-aided diagnosis (CAD) systems, integrated into the diagnostic process, aid in risk stratification and minimize unnecessary interventions. Despite these advancements, challenges persist, including the need for standardized TIRADS, the role of US elastography in routine practice, and the integration of AI into clinical protocols. However, the integration of clinical information, laboratory information, and multiparametric ultrasound features remains crucial for minimizing unnecessary interventions and guiding appropriate treatments. In conclusion, ultrasound plays a pivotal role in thyroid nodule management. Open questions regarding TIRADS selection, consistent use of US elastography, and the role of AI-based techniques underscore the need for ongoing research. Nonetheless, a comprehensive approach combining clinical, laboratory, and ultrasound data is recommended to minimize unnecessary interventions and treatments.
A systematic review of natural language processing applied to radiology reports

Arlene Casey,Emma Davidson,Michael Poon,Hang Dong,Daniel Duma,Andreas Grivas,Claire Grover,Víctor Suárez-Paniagua,Richard Tobin,William Whiteley,Honghan Wu,Beatrice Alex

DOI: https://doi.org/10.1186/s12911-021-01533-7

IF: 3.298

2021-06-03

BMC Medical Informatics and Decision Making

Abstract:Abstract Background Natural language processing (NLP) has a significant role in advancing healthcare and has been found to be key in extracting structured information from radiology reports. Understanding recent developments in NLP application to radiology is of significance but recent reviews on this are limited. This study systematically assesses and quantifies recent literature in NLP applied to radiology reports. Methods We conduct an automated literature search yielding 4836 results using automated filtering, metadata enriching steps and citation search combined with manual review. Our analysis is based on 21 variables including radiology characteristics, NLP methodology, performance, study, and clinical application characteristics. Results We present a comprehensive analysis of the 164 publications retrieved with publications in 2019 almost triple those in 2015. Each publication is categorised into one of 6 clinical application categories. Deep learning use increases in the period but conventional machine learning approaches are still prevalent. Deep learning remains challenged when data is scarce and there is little evidence of adoption into clinical practice. Despite 17% of studies reporting greater than 0.85 F1 scores, it is hard to comparatively evaluate these approaches given that most of them use different datasets. Only 14 studies made their data and 15 their code available with 10 externally validating results. Conclusions Automated understanding of clinical narratives of the radiology reports has the potential to enhance the healthcare process and we show that research in this field continues to grow. Reproducibility and explainability of models are important if the domain is to move applications into clinical use. More could be done to share code enabling validation of methods on different institutional data and to reduce heterogeneity in reporting of study properties allowing inter-study comparisons. Our results have significance for researchers in the field providing a systematic synthesis of existing work to build on, identify gaps, opportunities for collaboration and avoid duplication.

medical informatics
Between Always and Never: Evaluating Uncertainty in Radiology Reports Using Natural Language Processing

Andrew L. Callen,Sara M. Dupont,Adi Price,Ben Laguna,David McCoy,Bao Do,Jason Talbott,Marc Kohli,Jared Narvid

DOI: https://doi.org/10.1007/s10278-020-00379-1

IF: 4.903

2020-08-19

Journal of Digital Imaging

Abstract:The ideal radiology report reduces diagnostic uncertainty, while avoiding ambiguity whenever possible. The purpose of this study was to characterize the use of uncertainty terms in radiology reports at a single institution and compare the use of these terms across imaging modalities, anatomic sections, patient characteristics, and radiologist characteristics. We hypothesized that there would be variability among radiologists and between subspecialities within radiology regarding the use of uncertainty terms and that the length of the impression of a report would be a predictor of use of uncertainty terms. Finally, we hypothesized that use of uncertainty terms would often be interpreted by human readers as "hedging." To test these hypotheses, we applied a natural language processing (NLP) algorithm to assess and count the number of uncertainty terms within radiology reports. An algorithm was created to detect usage of a published set of uncertainty terms. All 642,569 radiology report impressions from 171 reporting radiologists were collected from 2011 through 2015. For validation, two radiologists without knowledge of the software algorithm reviewed report impressions and were asked to determine whether the report was "uncertain" or "hedging." The relationship between the presence of 1 or more uncertainty terms and the human readers' assessment was compared. There were significant differences in the proportion of reports containing uncertainty terms across patient admission status and across anatomic imaging subsections. Reports with uncertainty were significantly longer than those without, although report length was not significantly different between subspecialities or modalities. There were no significant differences in rates of uncertainty when comparing the experience of the attending radiologist. When compared with reader 1 as a gold standard, accuracy was 0.91, sensitivity was 0.92, specificity was 0.9, and precision was 0.88, with an F1-score of 0.9. When compared with reader 2, accuracy was 0.84, sensitivity was 0.88, specificity was 0.82, and precision was 0.68, with an F1-score of 0.77. Substantial variability exists among radiologists and subspecialities regarding the use of uncertainty terms, and this variability cannot be explained by years of radiologist experience or differences in proportions of specific modalities. Furthermore, detection of uncertainty terms demonstrates good test characteristics for predicting human readers' assessment of uncertainty.

radiology, nuclear medicine & medical imaging
Collaborative Enhancement of Consistency and Accuracy in US Diagnosis of Thyroid Nodules Using Large Language Models

Shao-Hong Wu,Wen-Juan Tong,Ming-De Li,Hang-Tong Hu,Xiao-Zhou Lu,Ze-Rong Huang,Xin-Xin Lin,Rui-Fang Lu,Ming-De Lu,Li-Da Chen,Wei Wang

DOI: https://doi.org/10.1148/radiol.232255

IF: 19.7

2024-03-13

Radiology

Abstract:Background Large language models (LLMs) hold substantial promise for medical imaging interpretation. However, there is a lack of studies on their feasibility in handling reasoning questions associated with medical diagnosis. Purpose To investigate the viability of leveraging three publicly available LLMs to enhance consistency and diagnostic accuracy in medical imaging based on standardized reporting, with pathology as the reference standard. Materials and Methods US images of thyroid nodules...

radiology, nuclear medicine & medical imaging
Transforming free-text radiology reports into structured reports using ChatGPT: A study on thyroid ultrasonography

Huan Jiang,ShuJun Xia,YiXuan Yang,JiaLe Xu,Qing Hua,ZiHan Mei,YiQing Hou,MinYan Wei,LiMei Lai,Ning Li,YiJie Dong,JianQiao Zhou,Jiale Xu,Zihan Mei,Yiqing Hou,Minyan Wei,Yijie Dong

DOI: https://doi.org/10.1016/j.ejrad.2024.111458

IF: 4.531

2024-04-11

European Journal of Radiology

Abstract:Purpose The importance of structured radiology reports has been fully recognized, as they facilitate efficient data extraction and promote collaboration among healthcare professionals. Our purpose is to assess the accuracy and reproducibility of ChatGPT, a large language model, in generating structured thyroid ultrasound reports. Methods This is a retrospective study that includes 184 nodules in 136 thyroid ultrasound reports from 136 patients. ChatGPT-3.5 and ChatGPT-4.0 were used to structure the reports based on ACR-TIRADS guidelines. Two radiologists evaluated the responses for quality, nodule categorization accuracy, and management recommendations. Each text was submitted twice to assess the consistency of the nodule classification and management recommendations. Results On 136 ultrasound reports from 136 patients (mean age, 52 years ± 12 [SD]; 61 male), ChatGPT-3.5 generated 202 satisfactory structured reports, while ChatGPT-4.0 only produced 69 satisfactory structured reports (74.3 % vs. 25.4 %, odds ratio (OR) = 8.490, 95 %CI: 5.775–12.481, p < 0.001). ChatGPT-4.0 outperformed ChatGPT-3.5 in categorizing thyroid nodules, with an accuracy of 69.3 % compared to 34.5 % (OR = 4.282, 95 %CI: 3.145–5.831, p < 0.001). ChatGPT-4.0 also provided more comprehensive or correct management recommendations than ChatGPT-3.5 (OR = 1.791, 95 %CI: 1.297–2.473, p < 0.001). Finally, ChatGPT-4.0 exhibits higher consistency in categorizing nodules compared to ChatGPT-3.5 (ICC = 0.732 vs. ICC = 0.429), and both exhibited moderate consistency in management recommendations (ICC = 0.549 vs ICC = 0.575). Conclusions Our study demonstrates the potential of ChatGPT in transforming free-text thyroid ultrasound reports into structured formats. ChatGPT-3.5 excels in generating structured reports, while ChatGPT-4.0 shows superior accuracy in nodule categorization and management recommendations.

radiology, nuclear medicine & medical imaging
Application of natural language processing to post-structuring of rectal cancer MRI reports

W Liu,L Cai,Y Li

DOI: https://doi.org/10.1016/j.crad.2023.10.032

Abstract:Aim: To evaluate a natural language processing (NLP) system for extracting structured information from the free-form text of rectal cancer magnetic resonance imaging (MRI) reports written in Chinese. Materials and methods: A rule-based NLP model that could extract 11 key image features of rectal cancer was constructed using 358 MRI reports of rectal cancer written between 2015 and 2021. Fifty reports written before 2015 and 50 written after 2021 were used as test datasets, and the reference standard was determined by manual extraction of information by two radiologists. The length and reporting rate of image features in pre-2015 and post-2021 datasets, as well as the accuracy, precision, recall, and F1 score of feature extraction by the NLP system, were compared. The time required for the NLP to extract data was compared with that required by the radiologists. Results: Reports written after 2021 had longer diagnostic impression sections than reports written before 2015. The reporting rate of key imaging features of rectal cancer was 36.55% before 2015 and 79.82% after 2021. The accuracy, precision, recall, and F1 score of NLP for correct extraction of values from reports were 93.82%, 95.63%, 87.06%, and 91.15%, respectively, for pre-2015 reports, and 92.55%, 98.53%, 94.15%, and 96.29%, respectively, for post-2021 reports. NLP generated all the structured information in <1 second. Conclusions: The NLP system with rule-based pattern matching achieved rapid and accurate structured processing of rectal cancer MRI reports. MRI reports with structured templates are more suitable for NLP-based extraction of information.
Natural Language Processing Accurately Differentiates Cancer Symptom Information in Electronic Health Record Narratives

Alaa Albashayreh,Anindita Bandyopadhyay,Nahid Zeinali,Min Zhang,Weiguo Fan,Stephanie Gilbertson White

DOI: https://doi.org/10.1200/CCI.23.00235

Abstract:Purpose: Identifying cancer symptoms in electronic health record (EHR) narratives is feasible with natural language processing (NLP). However, more efficient NLP systems are needed to detect various symptoms and distinguish observed symptoms from negated symptoms and medication-related side effects. We evaluated the accuracy of NLP in (1) detecting 14 symptom groups (ie, pain, fatigue, swelling, depressed mood, anxiety, nausea/vomiting, pruritus, headache, shortness of breath, constipation, numbness/tingling, decreased appetite, impaired memory, disturbed sleep) and (2) distinguishing observed symptoms in EHR narratives among patients with cancer. Methods: We extracted 902,508 notes for 11,784 unique patients diagnosed with cancer and developed a gold standard corpus of 1,112 notes labeled for presence or absence of 14 symptom groups. We trained an embeddings-augmented NLP system integrating human and machine intelligence and conventional machine learning algorithms. NLP metrics were calculated on a gold standard corpus subset for testing. Results: The interannotator agreement for labeling the gold standard corpus was excellent at 92%. The embeddings-augmented NLP model achieved the best performance (F1 score = 0.877). The highest NLP accuracy was observed in pruritus (F1 score = 0.937) while the lowest accuracy was in swelling (F1 score = 0.787). After classifying the entire data set with embeddings-augmented NLP, we found that 41% of the notes included symptom documentation. Pain was the most documented symptom (29% of all notes) while impaired memory was the least documented (0.7% of all notes). Conclusion: We illustrated the feasibility of detecting 14 symptom groups in EHR narratives and showed that an embeddings-augmented NLP system outperforms conventional machine learning algorithms in detecting symptom information and differentiating observed symptoms from negated symptoms and medication-related side effects.
Natural language processing for automated breast cancer recurrence detection and classification in computed tomography reports.

Jaimie Lee,Andres Zepeda,Gregory Arbour,Kathryn V. Isaac,Raymond T. Ng,Alan Nichol

DOI: https://doi.org/10.1200/jco.2024.42.16_suppl.e13591

IF: 45.3

2024-05-31

Journal of Clinical Oncology

Abstract:e13591 Background: Relapse is a major concern for oncologists and breast cancer survivors that necessitates additional treatment and often leads to mortality. Cancer registries routinely track cancer mortality, but few monitor for relapse because of logistical challenges and prohibitive costs. In this context, Natural Language Processing (NLP) is a promising tool. Merging artificial intelligence with linguistics, NLP can rapidly analyze vast volumes of text in electronic health records. This capability of NLP is particularly valuable for Computed Tomography (CT) scans used in breast cancer care. CT scans are routinely used to characterize breast cancer progression and are described in transcribed dictations by radiologists. We aimed to apply NLP to these text reports to identify breast cancer relapses. Objective: To automate breast cancer relapse detection and classification in CT text reports using NLP. Methods: We analyzed 1,445 CT text reports from patients diagnosed with breast cancer between January 1, 2005, and December 31, 2014. These reports underwent manual review by trained human annotators. Text was annotated to identify terminology defining local, regional, and distant breast cancer relapses. Annotated reports were partitioned into a training-validation set (90% cohort) and a test set (10% cohort) for NLP model development. Results: In our dataset of 1,445 CT text reports, 72 (5.0%) were classified as local relapse, 97 (6.7%) as regional relapse, and 743 (51.4%) as distant relapse. The performance of our NLP model using the training-validation dataset can be summarized by the following metrics and 95% confidence intervals: 94% (±3.2) accuracy for detection and 96% (±2.9) accuracy for classification. The performance of our NLP model was confirmed using the test dataset, with 90% (±4.5) accuracy for detection and 91% (±6.3) accuracy for classification. For reference, all metrics are outlined (Table). Conclusions: Our model for identifying regional and distant relapses in CT reports had excellent performance, but had lower sensitivity for local relapses, posing a risk of false negatives. Automating the identification and classification of breast cancer relapses, if used retrospectively, can enhance cancer registry data about patient outcomes and, if used prospectively, holds the potential for enhancing patient care. [Table: see text]

oncology

Acquisition and Fuzzy Processing of Physiological Signals to Obtain Human Stress Level Using Low Cost Portable Hardware

[Exploration on an Ultrasonographic Imaging Reporting and Data System in Malignancy Grading of Thyroid Nodules].

Extracting Thyroid Nodules Characteristics from Ultrasound Reports Using Transformer-based Natural Language Processing Methods

A Systematic Review of Natural Language Processing Methods and Applications in Thyroidology

Use of natural language processing to extract and classify papillary thyroid cancer features from surgical pathology reports

A Preliminary Study of Extracting Pulmonary Nodules and Nodule Characteristics from Radiology Reports Using Natural Language Processing

Thyroid Nodule Detection and Region Estimation in Ultrasound Images: A Comparison between Physicians and an Automated Decision Support System Approach

Natural Language Processing to Identify Abnormal Breast, Lung, and Cervical Cancer Screening Test Results from Unstructured Reports to Support Timely Follow-up.

Natural language processing for abstraction of cancer treatment toxicities: accuracy versus human experts

Implementing engineering education on the WWW: 3 case studies

Natural Language Processing Technologies in Radiology Research and Clinical Applications.

ARTIFICIAL INTELLIGENCE: NATURAL LANGUAGE PROCESSING FOR PEER-REVIEW IN RADIOLOGY

Multiparametric ultrasound evaluation of thyroid nodules

A systematic review of natural language processing applied to radiology reports

Between Always and Never: Evaluating Uncertainty in Radiology Reports Using Natural Language Processing

Collaborative Enhancement of Consistency and Accuracy in US Diagnosis of Thyroid Nodules Using Large Language Models

Transforming free-text radiology reports into structured reports using ChatGPT: A study on thyroid ultrasonography

Application of natural language processing to post-structuring of rectal cancer MRI reports

Natural Language Processing Accurately Differentiates Cancer Symptom Information in Electronic Health Record Narratives

Natural language processing for automated breast cancer recurrence detection and classification in computed tomography reports.