Abstract:Objective: Breast cancer is the most common malignant tumor among women. The diagnosis and treatment information of breast cancer patients is abundant in multiple types of clinical fields, including clinicopathological data, genotype and phenotype information, treatment information, and prognosis information. However, current studies are mainly focused on extracting information from one specific type of clinical field. This study defines a comprehensive information model to represent the whole-course clinical information of patients. Furthermore, deep learning approaches are used to extract the concepts and their attributes from clinical breast cancer documents by fine-tuning pretrained Bidirectional Encoder Representations from Transformers (BERT) language models. Materials and methods: The clinical corpus that was used in this study was from one 3A cancer hospital in China, consisting of the encounter notes, operation records, pathology notes, radiology notes, progress notes and discharge summaries of 100 breast cancer patients. Our system consists of two components: a named entity recognition (NER) component and a relation recognition component. For each component, we implemented deep learning-based approaches by fine-tuning BERT, which outperformed other state-of-the-art methods on multiple natural language processing (NLP) tasks. A clinical language model is first pretrained using BERT on a large-scale unlabeled corpus of Chinese clinical text. For NER, the context embeddings that were pretrained using BERT were used as the input features of the Bi-LSTM-CRF (Bidirectional long-short-memory-conditional random fields) model and were fine-tuned using the annotated breast cancer notes. Furthermore, we proposed an approach to fine-tune BERT for relation extraction. It was considered to be a classification problem in which the two entities that were mentioned in the input sentence were replaced with their semantic types. Results: Our best-performing system achieved F1 scores of 93.53% for the NER and 96.73% for the relation extraction. Additional evaluations showed that the deep learning-based approaches that fine-tuned BERT did outperform the traditional Bi-LSTM-CRF and CRF machine learning algorithms in NER and the attention-Bi-LSTM and SVM (support vector machines) algorithms in relation recognition. Conclusion: In this study, we developed a deep learning approach that fine-tuned BERT to extract the breast cancer concepts and their attributes. It demonstrated its superior performance compared to traditional machine learning algorithms, thus supporting its uses in broader NER and relation extraction tasks in the medical domain.

Automatic Extraction of Genomic Variants for Locating Precision Oncology Clinical Trials

A Medical Literature Search System for Identifying Effective Treatments in Precision Medicine

OncoCTMiner: streamlining precision oncology trial matching via molecular profile analysis

Extracting Systemic Anticancer Therapy and Response Information From Clinical Notes Following the RECIST Definition

Extracting Family History of Patients from Clinical Narratives: Exploring an End-to-End Solution with Deep Learning Models.

Automated Matching of Patients to Clinical Trials: A Patient-Centric Natural Language Processing Approach for Pediatric Leukemia

Clinical Trial Information Extraction with BERT

AutoCriteria: a generalizable clinical trial eligibility criteria extraction system powered by large language models

Extracting comprehensive clinical information for breast cancer using deep learning methods

Attention-Based LSTM Network for COVID-19 Clinical Trial Parsing

Text Classification of Cancer Clinical Trial Eligibility Criteria

Information Extraction of Clinical Trial Eligibility Criteria

Granularly, Precisely, and Timely: Leveraging Large Language Models for Safety and Efficacy Extraction in Oncology Clinical Trial Abstracts (SEETrials)

Towards Automated Knowledge Discovery of Hepatocellular Carcinoma - Extract Patient Information from Chinese Clinical Reports.

Automated medical chart review for breast cancer outcomes research: a novel natural language processing extraction system

Effective Matching of Patients to Clinical Trials using Entity Extraction and Neural Re-ranking

Automatic trial eligibility surveillance based on unstructured clinical data

An Approach for Transgender Population Information Extraction and Summarization from Clinical Trial Text

SEETrials: Leveraging Large Language Models for Safety and Efficacy Extraction in Oncology Clinical Trials

Exploring the Generalization of Cancer Clinical Trial Eligibility Classifiers Across Diseases

Understanding Clinical Trial Reports: Extracting Medical Entities and Their Relations