Abstract:Importance:Although critical to patient safety, health care-related allergic reactions are challenging to identify and monitor.Objective:To develop a deep learning model to identify allergic reactions in the free-text narrative of hospital safety reports and evaluate its generalizability, efficiency, productivity, and interpretability.Design, Setting, and Participants:This cross-sectional study analyzed hospital safety reports filed between May 2004 and January 2019 at Brigham and Women's Hospital and between April 2006 and June 2018 at Massachusetts General Hospital in Boston. Training and validating a deep learning model involved extracting safety reports using 101 expert-curated keywords from Massachusetts General Hospital (data set I). The model was then evaluated on 3 data sets: reports without keywords (data set II), reports from a different time frame (data set III), and reports from a different hospital (Brigham and Women's Hospital; data set IV). Statistical analyses were performed between March 1, 2019, and July 18, 2020.Main Outcomes and Measures:The area under the receiver operating characteristic curve and area under the precision-recall curve were used on data set I. The precision at top-k was used on data sets II to IV.Results:A total of 299 028 safety reports with 172 854 patients were included. Of these patients, 86 544 were women (50.1%) and the median (interquartile range [IQR]) age was 59.7 (43.8-71.6) years. The deep learning model achieved an area under the receiver operating characteristic curve of 0.979 (95% CI, 0.973-0.985) and an area under the precision-recall curve of 0.809 (95% CI, 0.773-0.845). The model achieved precisions at the top 100 model-identified cases of 0.930 in data set II, 0.960 in data set III, and 0.990 in data set IV. Compared with the keyword-search approach, the deep learning model reduced the number of cases for manual review by 63.8% and identified 24.2% more cases of confirmed allergic reactions. The model highlighted important words (eg, rash, hives, and Benadryl) in prediction and extended the list of expert-curated keywords through an attention layer.Conclusions and Relevance:This study showed that a deep learning model can accurately and efficiently identify allergic reactions using free-text narratives written by a variety of health care professionals. This model could be used to improve allergy care, potentially enabling real-time event surveillance and guidance for medical errors and system improvement.

Allergy Wheal and Erythema Segmentation Using Attention U-Net

Deep Learning Method Applied to Autonomous Image Diagnosis for Prick Test

Segmentation of acetowhite region in uterine cervical image based on deep learning

Development and Validation of a Deep Learning Model for Detection of Allergic Reactions Using Safety Event Reports Across Hospitals

Human vs Machine in Bioengineering Allergology: A Comparative Analysis of Conventional vs Innovative Methods for Quantifying Allergological Skin Prick Tests

Deep Learning-Based Semantic Segmentation of Non-Melanocytic Skin Tumors in Whole-Slide Histopathological Images.

PECNet: A Deep Multi-Label Segmentation Network for Eosinophilic Esophagitis Biopsy Diagnostics

A Pressure Ulcer Care System For Remote Medical Assistance: Residual U-Net with an Attention Model Based for Wound Area Segmentation

Hyperspectral imaging‐based erythema classification in atopic dermatitis

SEACU-Net: Attentive ConvLSTM U-Net with squeeze-and-excitation layer for skin lesion segmentation

Image classification and auxiliary diagnosis system for hyperpigmented skin diseases based on deep learning

HWA-SegNet: Multi-channel skin lesion image segmentation network with hierarchical analysis and weight adjustment

Deep learning approach to skin layers segmentation in inflammatory dermatoses

Automatic HEp-2 cell segmentation in indirect immunofluorescence images using deep learning

Visual In-Context Learning for Few-Shot Eczema Segmentation

A deep learning-based hybrid artificial intelligence model for the detection and severity assessment of vitiligo lesions

Segmentation of both Diseased and Healthy Skin from Clinical Photographs in a Primary Care Setting

ELA-Net: An Efficient Lightweight Attention Network for Skin Lesion Segmentation

[Image segmentation of skin lesions based on dense atrous spatial pyramid pooling and attention mechanism]

Simple Code Implementation for Deep Learning–Based Segmentation to Evaluate Central Serous Chorioretinopathy in Fundus Photography

The role of allergen-specific IgE in predicting allergic symptoms on dog and cat exposure among Korean pet exhibition participants