Abstract:Background: Manually extracted data points from health records are collated on an institutional, provincial, and national level to facilitate clinical research. However, the labour-intensive clinical chart review process puts an increasing burden on healthcare system budgets. Therefore, an automated information extraction system is needed to ensure the timeliness and scalability of research data. Methods: We used a dataset of 100 synoptic operative and 100 pathology reports, evenly split into 50 reports in training and test sets for each report type. The training set guided our development of a Natural Language Processing (NLP) extraction pipeline system, which accepts scanned images of operative and pathology reports. The system uses a combination of rule-based and transfer learning methods to extract numeric encodings from text. We also developed visualization tools to compare the manual and automated extractions. The code for this paper was made available on GitHub. Results: A test set of 50 operative and 50 pathology reports were used to evaluate the extraction accuracies of the NLP pipeline. Gold standard, defined as manual extraction by expert reviewers, yielded accuracies of 90.5% for operative reports and 96.0% for pathology reports, while the NLP system achieved overall 91.9% (operative) and 95.4% (pathology) accuracy. The pipeline successfully extracted outcomes data pertinent to breast cancer tumor characteristics (e.g. presence of invasive carcinoma, size, histologic type), prognostic factors (e.g. number of lymph nodes with micro-metastases and macro-metastases, pathologic stage), and treatment-related variables (e.g. margins, neo-adjuvant treatment, surgical indication) with high accuracy. Out of the 48 variables across operative and pathology codebooks, NLP yielded 43 variables with F-scores of at least 0.90; in comparison, a trained human annotator yielded 44 variables with F-scores of at least 0.90. Conclusions: The NLP system achieves near-human-level accuracy in both operative and pathology reports using a minimal curated dataset. This system uniquely provides a robust solution for transparent, adaptable, and scalable automation of data extraction from patient health records. It may serve to advance breast cancer clinical research by facilitating collection of vast amounts of valuable health data at a population level.

Automatic patient search for breast cancer clinical trials using free-text medical reports

Automated search for patient records

Automated search for patient records: classification of free-text medical reports using conditional random fields

Automatic Patient Search Using Bernoulli Model

Automatic trial eligibility surveillance based on unstructured clinical data

Natural Language Processing to Identify Abnormal Breast, Lung, and Cervical Cancer Screening Test Results from Unstructured Reports to Support Timely Follow-up.

Automated Matching of Patients to Clinical Trials: A Patient-Centric Natural Language Processing Approach for Pediatric Leukemia

Extracting Diagnoses and Investigation Results from Unstructured Text in Electronic Health Records by Semi-Supervised Machine Learning

Automated Classification of Free-text Pathology Reports for Registration of Incident Cases of Cancer

Automated medical chart review for breast cancer outcomes research: a novel natural language processing extraction system

Automating Clinical Chart Review: An Open-Source Natural Language Processing Pipeline Developed on Free-Text Radiology Reports From Patients With Glioblastoma

An Automated Method for Gender Information Identification from Clinical Trial Texts

An innovative solution for breast cancer textual big data analysis

A Medical Literature Search System for Identifying Effective Treatments in Precision Medicine

Evaluating Methods for Identifying Cancer in Free-Text Pathology Reports Using Various Machine Learning and Data Preprocessing Approaches

AI Assisted Method for Efficiently Generating Breast Ultrasound Screening Reports

Automated classification of eligibility criteria in clinical trials to facilitate patient-trial matching for specific patient populations

Text Mining in Radiology Reports

Extraction of Biomedical Informtion Related to Breast Cancer Using Text Mining.

Automatic extraction of imaging observation and assessment categories from breast magnetic resonance imaging reports with natural language processing.

OncoCTMiner: streamlining precision oncology trial matching via molecular profile analysis