Abstract:e13624 Background: Cancer staging is instrumental in driving clinical management and trial enrollment, but staging data are generally unreliable and unstructured in the electronic health record (EHR). Advances in natural language processing (NLP) may facilitate clinical staging and documentation [1], but challenges to real-world implementation include (1) automatically identifying appropriate patients and reports from the EHR and (2) developing an unbiased dataset for training and validation [2]. We describe our institution’s novel approach to overcome these barriers while building an in-house NLP pipeline for clinical tumor staging of non-small-cell lung cancer (NSCLC). Methods: We identified patients by searching our EHR (Epic) for a molecular analysis test ordered specifically for pathological diagnoses of NSCLC at our institution. We used the test order date as the diagnosis proxy date (DPD). For each patient, we extracted imaging reports up to 16 weeks before and 6 weeks after the DPD. To derive primary tumor size, we analyzed the CT Chest or PET/CT report closest to the DPD using an oncology-trained NLP text extraction and labeling tool (John Snow Labs). We cleaned all extracted tumor size entities and identified the largest measurement linked to the lungs. We compared primary tumor measurements from the NLP pipeline to those in a preexisting, manually compiled cancer registry (CNEXT). We manually analyzed discrepancies through chart review. Results: 542 patients with a DPD between 11/2016 - 9/2023 were processed through the NLP pipeline. Of 443 patients with valid values in both the pipeline and CNEXT, 53% (234) were exact matches, and 20% (90) had a close match (within 0-5mm), yielding a 73% accuracy rate for values within 5mm. When mismatched values were manually reviewed, several cases in CNEXT were found to have a DPD differing by more than 3 months and tumor sizes derived from external reports. When these cases were excluded, 320 of the remaining 349 patients had valid values in both the pipeline and the updated manual review. In this refined population, 66% (213) were exact matches, and 15% (48) had a close match, yielding an 82% accuracy rate for values within 5mm. Conclusions: To our knowledge, this is the first report of a pathology-based method to automatically and reliably identify patients with NSCLC and their relevant imaging reports directly from the EHR. We used a prebuilt NLP tool to derive primary tumor sizes with relatively high accuracy and found that adding flags for timeline discrepancies and external reports can further improve validity. As we near completion of analogous pipelines for node and metastasis staging, we will develop methodology to identify subgroups of patients that can be clinically staged with near-perfect accuracy, ultimately aiming to substantially limit manual staging of uncomplicated cases. 1. Puts 2023. 2. Wang 2022.

The accuracy of clinical staging of stage I-IIIa non-small cell lung cancer: an analysis based on individual participant data

Factors affecting accuracy of clinical staging in resectable non‐small cell lung cancer in a real‐world study

Real-world Surgical Treatment Patterns and Clinical Outcomes in Patients with Stages IA–IIIA Non-Small Cell Lung Cancer: a Retrospective Multicentric Observational Study Involving 11,958 Patients

Preoperative Lymph Node Assessment in Surgically Resected Pathologic T1 Lung Cancer Patients: Real World Clinical Practice in China.

What Is the Accuracy of Clinical Staging for Stage III-Single-station N2 NSCLC? A Multi-Centre UK Study

Surgical Intervention Improves Survival for Metastatic Non-Small Cell Lung Cancer Patients.

Real-World Analysis of Survival and Treatment Efficacy in Stage IIIA-N2 Non-Small Cell Lung Cancer

Staging accuracy in patients with clinical T2N0 gastric cancer: Implications for treatment sequencing

Multivariate Survival Analysis of Patients with Stage I NSCLC

A practical molecular assay to predict survival in resected non-squamous, non-small-cell lung cancer: development and international validation studies

Staging of Early-Stage Lung Cancer without Routine PET in Candidates for Segmentectomy

Multimodal Treatment in Operable Stage III Non-Small Cell Lung Cancer Using the New TNM Staging Classification Version 8: Long Term Results of a Pooled Analysis of Three SAKK Trials

The IASLC lung cancer staging project: methodology and validation used in the development of proposals for revision of the stage classification of NSCLC in the forthcoming …

Surgical versus clinical staging prior to primary chemoradiation in patients with cervical cancer FIGO stages IIB–IVA: oncologic results of a prospective randomized international multicenter (Uterus-11) intergroup study

Novel approach to implementing natural language processing for clinical staging of non-small-cell lung cancer.

Correlation Between Clinical and Pathologic Staging in Colon Cancer: Implications for Neoadjuvant Treatment

Respiratory and Cardiometabolic Comorbidities and Stages I to III NSCLC Survival: A Pooled Analysis from the International Lung Cancer Consortium

Survival Analysis of 220 Patients with Completely Resected Stage-Ii Non-Small Cell Lung Cancer

Consistency and prognostic value of preoperative staging and postoperative pathological staging using 18F-FDG PET/MRI in patients with non-small cell lung cancer

Multimodal Treatment in Operable Stage III NSCLC: A Pooled Analysis on Long-Term Results of Three SAKK Trials (SAKK 16/96, 16/00, and 16/01)

Study of prognostic predictors for non-small cell lung cancer