Abstract:Purpose: The RECIST guidelines provide a standardized approach for evaluating the response of cancer to treatment, allowing for consistent comparison of treatment efficacy across different therapies and patients. However, collecting such information from electronic health records manually can be extremely labor-intensive and time-consuming because of the complexity and volume of clinical notes. The aim of this study is to apply natural language processing (NLP) techniques to automate this process, minimizing manual data collection efforts, and improving the consistency and reliability of the results. Methods: We proposed a complex, hybrid NLP system that automates the process of extracting, linking, and summarizing anticancer therapy and associated RECIST-like responses from narrative clinical text. The system consists of multiple machine learning-/deep learning-based and rule-based modules for diverse NLP tasks such as named entity recognition, assertion classification, relation extraction, and text normalization, to address different challenges associated with anticancer therapy and response information extraction. We then evaluated the system performances on two independent test sets from different institutions to demonstrate its effectiveness and generalizability. Results: The system used domain-specific language models, BioBERT and BioClinicalBERT, for high-performance therapy mentions identification and RECIST responses extraction and categorization. The best-performing model achieved a 0.66 score in linking therapy and RECIST response mentions, with end-to-end performance peaking at 0.74 after relation normalization, indicating substantial efficacy with room for improvement. Conclusion: We developed, implemented, and tested an information extraction system from clinical notes for cancer treatment and efficacy assessment information. We expect this system will support future cancer research, particularly oncologic studies that focus on efficiently assessing the effectiveness and reliability of cancer therapeutics.

A Natural Language Processing Tool to Extract Quantitative Smoking Status from Clinical Narratives.

A Preliminary Study of Extracting Pulmonary Nodules and Nodule Characteristics from Radiology Reports Using Natural Language Processing

Natural language processing for populating lung cancer clinical research data

A Study of Transportability of an Existing Smoking Status Detection Module Across Institutions.

Comparison of Three Information Sources for Smoking Information in Electronic Health Records

Natural Language Processing to Identify Abnormal Breast, Lung, and Cervical Cancer Screening Test Results from Unstructured Reports to Support Timely Follow-up.

An Automated Approach For Clinical Quantitative Information Extraction From Chinese Electronic Medical Records

Extracting Important Information From Chinese Operation Notes With Natural Language Processing Methods

Keyword Extraction Algorithm for Classifying Smoking Status from Unstructured Bilingual Electronic Health Records Based on Natural Language Processing

Natural language processing and machine learning to enable automatic extraction and classification of patients’ smoking status from electronic medical records

A Study of Social and Behavioral Determinants of Health in Lung Cancer Patients Using Transformers-based Natural Language Processing Models

A Natural Language Processing Pipeline of Chinese Free-text Radiology Reports for Liver Cancer Diagnosis

Extracting Systemic Anticancer Therapy and Response Information From Clinical Notes Following the RECIST Definition

A query interface for clinical research with Chinese electronic health record using Natural Language Processing

Extracting Clinical Information from Free-Text of Pathology and Operation Notes Via Chinese Natural Language Processing.

Leveraging natural language processing to identify eligible lung cancer screening patients with the electronic health record

Natural Language Processing Accurately Differentiates Cancer Symptom Information in Electronic Health Record Narratives

Using Natural Language Processing to Extract Clinically Useful Information from Chinese Electronic Medical Records

Automatic extraction of imaging observation and assessment categories from breast magnetic resonance imaging reports with natural language processing.

Development of a Structured Query Language and Natural Language Processing Algorithm to Identify Lung Nodules in a Cancer Centre

A Combined Classification Model for Chinese Clinical Notes