Abstract:OBJECTIVE: Social determinants of health (SDOH) are non-medical factors that can profoundly impact patient health outcomes. However, SDOH are rarely available in structured electronic health record (EHR) data such as diagnosis codes, and more commonly found in unstructured narrative clinical notes. Hence, identifying social context from unstructured EHR data has become increasingly important. Yet, previous work on using natural language processing to automate extraction of SDOH from text (a) usually focuses on an ad hoc selection of SDOH, and (b) does not use the latest advances in deep learning. Our objective was to advance automatic extraction of SDOH from clinical text by (a) systematically creating a set of SDOH based on standard biomedical and psychiatric ontologies, and (b) training state-of-the-art deep neural networks to extract mentions of these SDOH from clinical notes.DESIGN: A retrospective cohort study.SETTING AND PARTICIPANTS: Data were extracted from the Medical Information Mart for Intensive Care (MIMIC-III) database. The corpus comprised 3,504 social related sentences from 2,670 clinical notes.METHODS: We developed a framework for automated classification of multiple SDOH categories. Our dataset comprised narrative clinical notes under the "Social Work" category in the MIMIC-III Clinical Database. Using standard terminologies, SNOMED-CT and DSM-IV, we systematically curated a set of 13 SDOH categories and created annotation guidelines for these. After manually annotating the 3,504 sentences, we developed and tested three deep neural network (DNN) architectures - convolutional neural network (CNN), long short-term memory (LSTM) network, and the Bidirectional Encoder Representations from Transformers (BERT) - for automated detection of eight SDOH categories. We also compared these DNNs to three baselines models: (1) cTAKES, as well as (2) L2-regularized logistic regression and (3) random forests on bags-of-words. Model evaluation metrics included micro- and macro- F1, and area under the receiver operating characteristic curve (AUC).RESULTS: All three DNN models accurately classified all SDOH categories (minimum micro-F1 = 0.632, minimum macro-AUC = 0.854). Compared to the CNN and LSTM, BERT performed best in most key metrics (micro-F1 = 0.690, macro-AUC = 0.907). The BERT model most effectively identified the "occupational" category (F1 = 0.774, AUC = 0.965) and least effectively identified the "non-SDOH" category (F = 0.491, AUC = 0.788). BERT outperformed cTAKES in distinguishing social vs non-social sentences (BERT F1 = 0.87 vs. cTAKES F1 = 0.06), and outperformed logistic regression (micro-F1 = 0.649, macro-AUC = 0.696) and random forest (micro-F1 = 0.502, macro-AUC = 0.523) trained on bag-of-words.CONCLUSIONS: Our study framework with DNN models demonstrated improved performance for efficiently identifying a systematic range of SDOH categories from clinical notes in the EHR. Improved identification of patient SDOH may further improve healthcare outcomes.

A PSO-based Deep Learning Approach to Classifying Patients from Emergency Departments

Deep Dynamic Patient Similarity Analysis: Model Development and Validation in ICU.

Design and Application of Deep Belief Network Based on Stochastic Adaptive Particle Swarm Optimization

Multi-label Classification of Abnormalities in 12-Lead ECG Using Deep Learning.

Dynamical system based compact deep hybrid network for classification of Parkinson disease related EEG signals

Classifying social determinants of health from unstructured electronic health records using deep learning-based natural language processing

Deep Ordinal Neural Network for Length of Stay Estimation in the Intensive Care Units.

A Convolutional Neural Network Algorithm for the Optimization of Emergency Nursing Rescue Efficiency for Critical Patients

Emergency department disposition prediction using a deep neural network with integrated clinical narratives and structured data

Research on Prediction of Medical Training Effect Based on PSO-BP Neural Network

Dealing with the Missing, Imbalanced and Sparse Features Problems in Emergency Data Using Random Forest, K-means and PCA Respectively (Preprint)

Multi-Modal Data Analysis for Pneumonia Status Prediction Using Deep Learning (MDA-PSP)

A novel deep learning algorithm for real-time prediction of clinical deterioration in the emergency department for a multimodal clinical decision support system

Survival in patients with oral and maxillofacial diffuse large B-cell lymphoma.

An adaptive and altruistic PSO-based deep feature selection method for Pneumonia detection from Chest X-rays

Implemented classification techniques for osteoporosis using deep learning from the perspective of healthcare analytics

Patients' Severity States Classification based on Electronic Health Record (EHR) Data using Multiple Machine Learning and Deep Learning Approaches

AEP-DLA: Adverse Event Prediction in Hospitalized Adult Patients Using Deep Learning Algorithms

Optimized Deep Feature Selection for Pneumonia Detection: A Novel RegNet and XOR-Based PSO Approach

PD-ARnet: a deep learning approach for Parkinson's disease diagnosis from resting-state fMRI

Towards accurate prediction of patient length of stay at emergency department: a GAN-driven deep learning framework