An Inversion of the Obstacle Problem and its Explicit Solution

H. Lewy

DOI: https://doi.org/10.1007/978-1-4612-2082-4_35

Abstract:

What problem does this paper attempt to address?

Cognitive-Behavioral Group Therapy versus Sertraline for Obsessive-Compulsive Disorder: Five-Year Follow-Up

C. Borges,E. Meyer,Y. Ferrão,F. Souza,M. B. Sousa,A. Cordioli

DOI: https://doi.org/10.1159/000322028

2011-05-04

Psychotherapy and Psychosomatics

Abstract:ated 5 years after the end of the initial randomized clinical trial. All subjects provided written informed consent that was approved by the institutional review board. The Yale-Brown Scale for Obsessive-Compulsive Symptoms (Y-BOCS) [5, 6] and the Clinical Global Impression scale – Severity (CGI-S, adapted version) [7] were used to assess the severity of OCD symptoms. The Beck Depression Inventory (BDI) [8, 9] and Beck Anxiety Inventory (BAI) [10, 11] were used to assess depressive and anxiety symptoms, respectively. Both patients treated with CBGT and those treated with sertraline showed a significant reduction in the severity of symptoms at the end of the treatments, and they maintained therapeutic gains 5 years after. We also verified that a significant group of patients who underwent CBGT (13; 62%) started taking antiobsessional medication (p ! 0.001); on the other hand, psychotherapy was given to the patients who had taken sertraline (8; 32%), but at a nonsignificant level (p = 0.084). A total of 10 patients (22%), 2 (9.5%) from the CBGT group and 8 (32%) from the sertraline group, had CBT in the 5-year follow-up period ( 2 = 3.06; p = 0.084). Almost 62% of all patients continued using or started using medication, and 41.5% started or continued undergoing CBT in the 5-year follow-up period. There was a significant increase in remissive patients (partial or full remission) in the sertraline group (p = 0.046); the same did not occur in the CBGT group (p = 0.083). Table 1 shows patients’ scores on the Y-BOCS, CGI, BAI and BDI, as well as the nonimprovement, partial remission, full remission and relapse at the time of the follow-up study. The Y-BOCS total score median rate of variation between the initial treatment trial and the 5-year follow-up in the CBGT group ( fig. 1 ) was a 42.9% increase, while in the sertraline group there was a reduction by 17% (U Wilcoxon-Mann-Whitney = 167.5; p = 0.036). Cognitive-behavioral therapy (CBT) and serotonin reuptake inhibitors (SRI) are the first-choice treatments for obsessive-compulsive disorder (OCD) [1, 2] . Cognitive-behavioral group therapy (CBGT) has effectiveness similar to one-to-one CBT [3] . Speculation still persists whether the CBT outcomes, and especially CBGT, are sustained in the long term and if there are differences between the outcomes of CBT and antiobsessional medication. The aim of the present study was to investigate whether the reduction in severity of OCD symptoms obtained with 12-weekly sessions of CBGT or with sertraline (100 mg/day) during the same period, in a randomized clinical trial, would be sustained over a 5-year period, as well as to compare the differences between the 2 treatments in the long term. The randomized clinical trial in which patients were treated has been described in detail elsewhere [4] . Forty-six patients (92% of the initial sample) who were treated with CBGT (n = 21; 46%) or sertraline (n = 25; 54%) were evaluReceived: June 25, 2010 Accepted after revision: October 6, 2010 Published online: May 4, 2011
Use of natural language processing to uncover racial bias in obstetrical documentation

Itamar D. Futterman,Hila Friedmann,Oleksii Shpanel-Yukhta,Howard Minkoff,Shoshana Haberman

DOI: https://doi.org/10.1016/j.clinimag.2024.110164

IF: 2.42

2024-04-23

Clinical Imaging

Abstract:Natural Language Processing (NLP), a form of Artificial Intelligence, allows free-text based clinical documentation to be integrated in ways that facilitate data analysis, data interpretation and formation of individualized medical and obstetrical care. In this cross-sectional study, we identified all births during the study period carrying the radiology-confirmed diagnosis of fibroid uterus in pregnancy (defined as size of largest diameter of >5 cm) by using an NLP platform and compared it to non-NLP derived data using ICD10 codes of the same diagnosis. We then compared the two sets of data and stratified documentation gaps by race. Using fibroid uterus in pregnancy as a marker, we found that Black patients were more likely to have the diagnosis entered late into the patient's chart or had missing documentation of the diagnosis. With appropriate algorithm definitions, cross referencing and thorough validation steps, NLP can contribute to identifying areas of documentation gaps and improve quality of care.

radiology, nuclear medicine & medical imaging
[Cholestasis. Diagnostic value of immunoelectrophoresis].

J. Balanzó,G. Buendía,A. Ferragut,R. Vidal-Ribas

1969-10-15

Abstract:
CARE-SD: Classifier-based analysis for recognizing and eliminating stigmatizing and doubt marker labels in electronic health records: model development and validation

Drew Walker,Annie Thorne,Sudeshna Das,Jennifer Love,Hannah LF Cooper,Melvin Livingston III,Abeed Sarker

2024-05-09

Abstract:Objective: To detect and classify features of stigmatizing and biased language in intensive care electronic health records (EHRs) using natural language processing techniques. Materials and Methods: We first created a lexicon and regular expression lists from literature-driven stem words for linguistic features of stigmatizing patient labels, doubt markers, and scare quotes within EHRs. The lexicon was further extended using Word2Vec and GPT 3.5, and refined through human evaluation. These lexicons were used to search for matches across 18 million sentences from the de-identified Medical Information Mart for Intensive Care-III (MIMIC-III) dataset. For each linguistic bias feature, 1000 sentence matches were sampled, labeled by expert clinical and public health annotators, and used to supervised learning classifiers. Results: Lexicon development from expanded literature stem-word lists resulted in a doubt marker lexicon containing 58 expressions, and a stigmatizing labels lexicon containing 127 expressions. Classifiers for doubt markers and stigmatizing labels had the highest performance, with macro F1-scores of .84 and .79, positive-label recall and precision values ranging from .71 to .86, and accuracies aligning closely with human annotator agreement (.87). Discussion: This study demonstrated the feasibility of supervised classifiers in automatically identifying stigmatizing labels and doubt markers in medical text, and identified trends in stigmatizing language use in an EHR setting. Additional labeled data may help improve lower scare quote model performance. Conclusions: Classifiers developed in this study showed high model performance and can be applied to identify patterns and target interventions to reduce stigmatizing labels and doubt markers in healthcare systems.

Computation and Language
A Team Public Health Research Project for First-Year Pharmacy Students to Apply Content From Didactic Courses

David G Fuentes,Nancy Deguire,Rajul A. Patel,E. Boyce

DOI: https://doi.org/10.5688/aj740699

IF: 2.876

2010-08-10

American Journal of Pharmaceutical Education

Abstract:Objectives. To implement and assess a first-year pharmacy student group research project that provided practical hands-on application and reinforced the curricula of concurrent didactic courses. Design. Groups of 6 to 7 students chose a public health topic based on the Healthy People 2010 Priority Areas and created a survey instrument. Faculty facilitated mock institutional review board (IRB) review sessions which provided teams with ongoing feedback and refinement recommendations before each team administered their survey instrument to a predefined population. Data analysis, formal written reports, and oral presentations were presented to peers and project faculty members. Assessment. Teams complied with the requirements of the mock IRB, effectively applied basic research principles learned in class, collected survey data, performed inferential statistical analyses on the data, and presented their project findings. Two-hundred six of 210 students (98%) reported feeling satisfied with both the results of their project and the accomplishments of their team. Conclusions. Teams applied a varied skill set including primary literature evaluation, basic research principles, statistics, public speaking, and peer collaboration in conducting a public health research project. First-year pharmacy students may benefit from participation in a collaborative research project that provides hands-on application of material being taught in didactic courses.
Identifying and Characterizing Bias at Scale in Clinical Notes Using Large Language Models

Donald U Apakama,Kim-Anh-Nhi Nguyen,Daphnee Hyppolite,Shelly Soffer,Aya Mudrik,Emilia Ling,Akini Moses,Ivanka Temnycky,Allison Glasser,Rebecca Anderson,Prathamesh Parchure,Evajoyce Woullard,Masoud Edalati,Lili Chan,Clair Kronk,Robert Freeman,Arash Kia,Prem Timsina,Matthew Levin,Rohan Khera,Patricia Patricia Kovatch,Alexander W. Charney,Brendan G. Carr,Lynne D. Richardson,Carol R. Horowitz,Eyal Klang,Girish Nadkarni

DOI: https://doi.org/10.1101/2024.10.24.24316073

2024-10-25

Abstract:Importance. Discriminatory language in clinical documentation impacts patient care and reinforces systemic biases. Scalable tools to detect and mitigate this are needed. Objective. Determine utility of a frontier large language model (GPT-4) in identifying and categorizing biased language and evaluate its suggestions for debiasing. Design. Cross-sectional study analyzing emergency department (ED) notes from the Mount Sinai Health System (MSHS) and discharge notes from MIMIC-IV. Setting. MSHS, a large urban healthcare system, and MIMIC-IV, a public dataset. Participants. We randomly selected 50,000 ED medical and nursing notes from 230,967 MSHS 2023 adult ED visiting patients, and 500 randomly selected discharge notes from 145,915 patients in MIMIC-IV database. One note was selected for each unique patient. Main Outcomes and Measures. Primary measure was accuracy of detection and categorization (discrediting, stigmatizing/labeling, judgmental, and stereotyping) of bias compared to human review. Secondary measures were proportion of patients with any bias, differences in the prevalence of bias across demographic and socioeconomic subgroups, and provider ratings of effectiveness of GPT-4's debiasing language. Results. Bias was detected in 6.5% of MSHS and 7.4% of MIMIC-IV notes. Compared to manual review, GPT-4 had sensitivity of 95%, specificity of 86%, positive predictive value of 84% and negative predictive value of 96% for bias detection. Stigmatizing/labeling (3.4%), judgmental (3.2%), and discrediting (4.0%) biases were most prevalent. There was higher bias in Black patients (8.3%), transgender individuals (15.7% for trans-female, 16.7% for trans-male), and undomiciled individuals (27%). Patients with non-commercial insurance, particularly Medicaid, also had higher bias (8.9%). Higher bias was also seen in health-related characteristics like frequent healthcare utilization (21% for >100 visits) and substance use disorders (32.2%). Physician-authored notes showed higher bias than nursing notes (9.4% vs. 4.2%, p < 0.001). GPT-4's suggested revisions were rated highly effective by physicians, with an average improvement score of 9.6/10 in reducing bias. Conclusions and Relevance. A frontier LLM effectively identified biased language, without further training, showing utility as a scalable fairness tool. High bias prevalence linked to certain patient characteristics underscores the need for targeted interventions. Integrating AI to facilitate unbiased documentation could significantly impact clinical practice and health outcomes.

Emergency Medicine
Measuring Implicit Bias in ICU Notes Using Word-Embedding Neural Network Models

Julien Cobert,Hunter Mills,Albert Lee,Oksana Gologorskaya,Edie Espejo,Sun Young Jeon,W John Boscardin,Timothy A Heintz,Christopher J Kennedy,Deepshikha C Ashana,Allyson Cook Chapman,Karthik Raghunathan,Alex K Smith,Sei J Lee

DOI: https://doi.org/10.1016/j.chest.2023.12.031

IF: 9.6

Chest

Abstract:Background: Language in nonmedical data sets is known to transmit human-like biases when used in natural language processing (NLP) algorithms that can reinforce disparities. It is unclear if NLP algorithms of medical notes could lead to similar transmissions of biases. Research question: Can we identify implicit bias in clinical notes, and are biases stable across time and geography? Study design and methods: To determine whether different racial and ethnic descriptors are similar contextually to stigmatizing language in ICU notes and whether these relationships are stable across time and geography, we identified notes on critically ill adults admitted to the University of California, San Francisco (UCSF), from 2012 through 2022 and to Beth Israel Deaconess Hospital (BIDMC) from 2001 through 2012. Because word meaning is derived largely from context, we trained unsupervised word-embedding algorithms to measure the similarity (cosine similarity) quantitatively of the context between a racial or ethnic descriptor (eg, African-American) and a stigmatizing target word (eg, nonco-operative) or group of words (violence, passivity, noncompliance, nonadherence). Results: In UCSF notes, Black descriptors were less likely to be similar contextually to violent words compared with White descriptors. Contrastingly, in BIDMC notes, Black descriptors were more likely to be similar contextually to violent words compared with White descriptors. The UCSF data set also showed that Black descriptors were more similar contextually to passivity and noncompliance words compared with Latinx descriptors. Interpretation: Implicit bias is identifiable in ICU notes. Racial and ethnic group descriptors carry different contextual relationships to stigmatizing words, depending on when and where notes were written. Because NLP models seem able to transmit implicit bias from training data, use of NLP algorithms in clinical prediction could reinforce disparities. Active debiasing strategies may be necessary to achieve algorithmic fairness when using language models in clinical research.
Secondary Qualitative Analysis of Stigmatizing and Nonstigmatizing Language Used in Hospital Birth Settings

Veronica Barcelona,Jihye K. Scroggins,Danielle Scharp,Sarah E. Harkins,Dena Goffman,Janice Aubey,Maxim Topaz

DOI: https://doi.org/10.1016/j.jogn.2024.10.003

2024-11-25

Abstract:We extend previous work studying stigmatizing language in clinical notes from birth settings to include new stigmatizing and nonstigmatizing language categories.

nursing,obstetrics & gynecology
NLP for Maternal Healthcare: Perspectives and Guiding Principles in the Age of LLMs

Maria Antoniak,Aakanksha Naik,Carla S. Alvarado,Lucy Lu Wang,Irene Y. Chen

2024-01-24

Abstract:Ethical frameworks for the use of natural language processing (NLP) are urgently needed to shape how large language models (LLMs) and similar tools are used for healthcare applications. Healthcare faces existing challenges including the balance of power in clinician-patient relationships, systemic health disparities, historical injustices, and economic constraints. Drawing directly from the voices of those most affected, and focusing on a case study of a specific healthcare setting, we propose a set of guiding principles for the use of NLP in maternal healthcare. We led an interactive session centered on an LLM-based chatbot demonstration during a full-day workshop with 39 participants, and additionally surveyed 30 healthcare workers and 30 birthing people about their values, needs, and perceptions of NLP tools in the context of maternal health. We conducted quantitative and qualitative analyses of the survey results and interactive discussions to consolidate our findings into a set of guiding principles. We propose nine principles for ethical use of NLP for maternal healthcare, grouped into three themes: (i) recognizing contextual significance (ii) holistic measurements, and (iii) who/what is valued. For each principle, we describe its underlying rationale and provide practical advice. This set of principles can provide a methodological pattern for other researchers and serve as a resource to practitioners working on maternal health and other healthcare fields to emphasize the importance of technical nuance, historical context, and inclusive design when developing NLP technologies for clinical use.

Computation and Language
Classifying early infant feeding status from clinical notes using natural language processing and machine learning

Dominick J. Lemas,Xinsong Du,Masoud Rouhizadeh,Braeden Lewis,Simon Frank,Lauren Wright,Alex Spirache,Lisa Gonzalez,Ryan Cheves,Marina Magalhães,Ruben Zapata,Rahul Reddy,Ke Xu,Leslie Parker,Chris Harle,Bridget Young,Adetola Louis-Jaques,Bouri Zhang,Lindsay Thompson,William R. Hogan,François Modave

DOI: https://doi.org/10.1038/s41598-024-58299-x

IF: 4.6

2024-04-04

Scientific Reports

Abstract:The objective of this study is to develop and evaluate natural language processing (NLP) and machine learning models to predict infant feeding status from clinical notes in the Epic electronic health records system. The primary outcome was the classification of infant feeding status from clinical notes using Medical Subject Headings (MeSH) terms. Annotation of notes was completed using TeamTat to uniquely classify clinical notes according to infant feeding status. We trained 6 machine learning models to classify infant feeding status: logistic regression, random forest, XGBoost gradient descent, k-nearest neighbors, and support-vector classifier. Model comparison was evaluated based on overall accuracy, precision, recall, and F1 score. Our modeling corpus included an even number of clinical notes that was a balanced sample across each class. We manually reviewed 999 notes that represented 746 mother-infant dyads with a mean gestational age of 38.9 weeks and a mean maternal age of 26.6 years. The most frequent feeding status classification present for this study was exclusive breastfeeding [n = 183 (18.3%)], followed by exclusive formula bottle feeding [n = 146 (14.6%)], and exclusive feeding of expressed mother's milk [n = 102 (10.2%)], with mixed feeding being the least frequent [n = 23 (2.3%)]. Our final analysis evaluated the classification of clinical notes as breast, formula/bottle, and missing. The machine learning models were trained on these three classes after performing balancing and down sampling. The XGBoost model outperformed all others by achieving an accuracy of 90.1%, a macro-averaged precision of 90.3%, a macro-averaged recall of 90.1%, and a macro-averaged F1 score of 90.1%. Our results demonstrate that natural language processing can be applied to clinical notes stored in the electronic health records to classify infant feeding status. Early identification of breastfeeding status using NLP on unstructured electronic health records data can be used to inform precision public health interventions focused on improving lactation support for postpartum patients.

multidisciplinary sciences
Echoes of Biases: How Stigmatizing Language Affects AI Performance

Yizhi Liu,Weiguang Wang,Guodong Gordon Gao,Ritu Agarwal

2023-06-12

Abstract:Electronic health records (EHRs) serve as an essential data source for the envisioned artificial intelligence (AI)-driven transformation in healthcare. However, clinician biases reflected in EHR notes can lead to AI models inheriting and amplifying these biases, perpetuating health disparities. This study investigates the impact of stigmatizing language (SL) in EHR notes on mortality prediction using a Transformer-based deep learning model and explainable AI (XAI) techniques. Our findings demonstrate that SL written by clinicians adversely affects AI performance, particularly so for black patients, highlighting SL as a source of racial disparity in AI model development. To explore an operationally efficient way to mitigate SL's impact, we investigate patterns in the generation of SL through a clinicians' collaborative network, identifying central clinicians as having a stronger impact on racial disparity in the AI model. We find that removing SL written by central clinicians is a more efficient bias reduction strategy than eliminating all SL in the entire corpus of data. This study provides actionable insights for responsible AI development and contributes to understanding clinician behavior and EHR note writing in healthcare.

Artificial Intelligence,Computers and Society
Using Large Language Models to Annotate Complex Cases of Social Determinants of Health in Longitudinal Clinical Records

Alexandra Ralevski,Nadaa Taiyab,Michael Nossal,Lindsay Mico,Samantha N. Piekos,Jennifer Hadlock

DOI: https://doi.org/10.1101/2024.04.25.24306380

2024-04-27

Abstract:Social Determinants of Health (SDoH) are an important part of the exposome and are known to have a large impact on variation in health outcomes. In particular, housing stability is known to be intricately linked to a patient’s health status, and pregnant women experiencing housing instability (HI) are known to have worse health outcomes. Most SDoH information is stored in electronic health records (EHRs) as free text (unstructured) clinical notes, which traditionally required natural language processing (NLP) for automatic identification of relevant text or keywords. A patient’s housing status can be ambiguous or subjective, and can change from note to note or within the same note, making it difficult to use existing NLP solutions. New developments in NLP allow researchers to prompt LLMs to perform complex, subjective annotation tasks that require reasoning that previously could only be attempted by human annotators. For example, large language models (LLMs) such as GPT (Generative Pre-trained Transformer) enable researchers to analyze complex, unstructured data using simple prompts. We used a secure platform within a large healthcare system to compare the ability of GPT-3.5 and GPT-4 to identify instances of both current and past housing instability, as well as general housing status, from 25,217 notes from 795 pregnant women. Results from these LLMs were compared with results from manual annotation, a named entity recognition (NER) model, and regular expressions (RegEx). We developed a chain-of-thought prompt requiring evidence and justification for each note from the LLMs, to help maximize the chances of finding relevant text related to HI while minimizing hallucinations and false positives. Compared with GPT-3.5 and the NER model, GPT-4 had the highest performance and had a much higher recall (0.924) than human annotators (0.702) in identifying patients experiencing current or past housing instability, although precision was lower (0.850) compared with human annotators (0.971). In most cases, the evidence output by GPT-4 was similar or identical to that of human annotators, and there was no evidence of hallucinations in any of the outputs from GPT-4. Most cases where the annotators and GPT-4 differed were ambiguous or subjective, such as “living in an apartment with too many people”. We also looked at GPT-4 performance on de-identified versions of the same notes and found that precision improved slightly (0.936 original, 0.939 de-identified), while recall dropped (0.781 original, 0.704 de-identified). This work demonstrates that, while manual annotation is likely to yield slightly more accurate results overall, LLMs, when compared with manual annotation, provide a scalable, cost-effective solution with the advantage of greater recall. At the same time, further evaluation is needed to address the risk of missed cases and bias in the initial selection of housing-related notes. Additionally, while it was possible to reduce confabulation, signs of unusual justifications remained. Given these factors, together with changes in both LLMs and charting over time, this approach is not yet appropriate for use as a fully-automated process. However, these results demonstrate the potential for using LLMs for computer-assisted annotation with human review, reducing cost and increasing recall. More efficient methods for obtaining structured SDoH data can help accelerate inclusion of exposome variables in biomedical research, and support healthcare systems in identifying patients who could benefit from proactive outreach.

Public and Global Health
Natural Language Processing in Electronic Health Records in Relation to Healthcare Decision-making: A Systematic Review

Elias Hossain,Rajib Rana,Niall Higgins,Jeffrey Soar,Prabal Datta Barua,Anthony R. Pisani,Ph.D,Kathryn Turner}

2023-06-22

Abstract:Background: Natural Language Processing (NLP) is widely used to extract clinical insights from Electronic Health Records (EHRs). However, the lack of annotated data, automated tools, and other challenges hinder the full utilisation of NLP for EHRs. Various Machine Learning (ML), Deep Learning (DL) and NLP techniques are studied and compared to understand the limitations and opportunities in this space comprehensively. Methodology: After screening 261 articles from 11 databases, we included 127 papers for full-text review covering seven categories of articles: 1) medical note classification, 2) clinical entity recognition, 3) text summarisation, 4) deep learning (DL) and transfer learning architecture, 5) information extraction, 6) Medical language translation and 7) other NLP applications. This study follows the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. Result and Discussion: EHR was the most commonly used data type among the selected articles, and the datasets were primarily unstructured. Various ML and DL methods were used, with prediction or classification being the most common application of ML or DL. The most common use cases were: the International Classification of Diseases, Ninth Revision (ICD-9) classification, clinical note analysis, and named entity recognition (NER) for clinical descriptions and research on psychiatric disorders. Conclusion: We find that the adopted ML models were not adequately assessed. In addition, the data imbalance problem is quite important, yet we must find techniques to address this underlining problem. Future studies should address key limitations in studies, primarily identifying Lupus Nephritis, Suicide Attempts, perinatal self-harmed and ICD-9 classification.

Computation and Language,Computers and Society
In-hospital cardiac arrest: characteristics and outcome after implementation of systematic practice-oriented training.

E. Ramberg,E. Wolsk,Jeanie M Elkjær,H. Bülow

DOI: https://doi.org/10.1016/j.ajem.2014.04.009

2014-07-01

Abstract:
Unveiling Disparities in Maternity Care: A Topic Modelling Approach to Analysing Maternity Incident Investigation Reports

Georgina Cosma,Mohit Kumar Singh,Patrick Waterson,Gyuchan Thomas Jun,Jonathan Back

2024-07-11

Abstract:This study applies Natural Language Processing techniques, including Latent Dirichlet Allocation, to analyse anonymised maternity incident investigation reports from the Healthcare Safety Investigation Branch. The reports underwent preprocessing, annotation using the Safety Intelligence Research taxonomy, and topic modelling to uncover prevalent topics and detect differences in maternity care across ethnic groups. A combination of offline and online methods was utilised to ensure data protection whilst enabling advanced analysis, with offline processing for sensitive data and online processing for non-sensitive data using the `Claude 3 Opus' language model. Interactive topic analysis and semantic network visualisation were employed to extract and display thematic topics and visualise semantic relationships among keywords. The analysis revealed disparities in care among different ethnic groups, with distinct focus areas for the Black, Asian, and White British ethnic groups. The study demonstrates the effectiveness of topic modelling and NLP techniques in analysing maternity incident investigation reports and highlighting disparities in care. The findings emphasise the crucial role of advanced data analysis in improving maternity care quality and equity.

Artificial Intelligence,Machine Learning
Can natural language processing models extract and classify instances of interpersonal violence in mental healthcare electronic records: an applied evaluative study

Riley Botelle,Vishal Bhavsar,Giouliana Kadra-Scalzo,Aurelie Mascio,Marcus V Williams,Angus Roberts,Sumithra Velupillai,Robert Stewart

DOI: https://doi.org/10.1136/bmjopen-2021-052911

IF: 3.006

2022-02-16

BMJ Open

Abstract:Objective: This paper evaluates the application of a natural language processing (NLP) model for extracting clinical text referring to interpersonal violence using electronic health records (EHRs) from a large mental healthcare provider. Design: A multidisciplinary team iteratively developed guidelines for annotating clinical text referring to violence. Keywords were used to generate a dataset which was annotated (ie, classified as affirmed, negated or irrelevant) for: presence of violence, patient status (ie, as perpetrator, witness and/or victim of violence) and violence type (domestic, physical and/or sexual). An NLP approach using a pretrained transformer model, BioBERT (Bidirectional Encoder Representations from Transformers for Biomedical Text Mining) was fine-tuned on the annotated dataset and evaluated using 10-fold cross-validation. Setting: We used the Clinical Records Interactive Search (CRIS) database, comprising over 500 000 de-identified EHRs of patients within the South London and Maudsley NHS Foundation Trust, a specialist mental healthcare provider serving an urban catchment area. Participants: Searches of CRIS were carried out based on 17 predefined keywords. Randomly selected text fragments were taken from the results for each keyword, amounting to 3771 text fragments from the records of 2832 patients. Outcome measures: We estimated precision, recall and F1 score for each NLP model. We examined sociodemographic and clinical variables in patients giving rise to the text data, and frequencies for each annotated violence characteristic. Results: Binary classification models were developed for six labels (violence presence, perpetrator, victim, domestic, physical and sexual). Among annotations affirmed for the presence of any violence, 78% (1724) referred to physical violence, 61% (1350) referred to patients as perpetrator and 33% (731) to domestic violence. NLP models' precision ranged from 89% (perpetrator) to 98% (sexual); recall ranged from 89% (victim, perpetrator) to 97% (sexual). Conclusions: State of the art NLP models can extract and classify clinical text on violence from EHRs at acceptable levels of scale, efficiency and accuracy.
The Power of Language in Hospital Care for Pregnant and Birthing People: A Vision for Change

Veronica Barcelona,Rose L Horton,Katherine Rivlin,Sarah Harkins,Coretta Green,Kenya Robinson,Janice J Aubey,Anita Holman,Dena Goffman,Shaconna Haley,Maxim Topaz

DOI: https://doi.org/10.1097/AOG.0000000000005333

2023-10-01

Abstract:Language is commonly defined as the principal method of human communication made up of words and conveyed by writing, speech, or nonverbal expression. In the context of clinical care, language has power and meaning and reflects priorities, beliefs, values, and culture. Stigmatizing language can communicate unintended meanings that perpetuate socially constructed power dynamics and result in bias. This bias may harm pregnant and birthing people by centering positions of power and privilege and by reflecting cultural priorities in the United States, including judgments of demographic and reproductive health characteristics. This commentary builds on relationship-centered care and reproductive justice frameworks to analyze the role and use of language in pregnancy and birth care in the United States, particularly regarding people with marginalized identities. We describe the use of language in written documentation, verbal communication, and behaviors associated with caring for pregnant people. We also present recommendations for change, including alternative language at the individual, clinician, hospital, health systems, and policy levels. We define birth as the emergence of a new individual from the body of its parent, no matter what intervention or pathology may be involved. Thus, we propose a cultural shift in hospital-based care for birthing people that centers the birthing person and reconceptualizes all births as physiologic events, approached with a spirit of care, partnership, and support.
Disparities in Documentation: Evidence of Race-Based Biases in the Electronic Medical Record

Zalaya K. Ivy,Sharon Hwee,Brittany C. Kimball,Michael D. Evans,Nicholas Marka,Catherine Bendel,Alexander A. Boucher

DOI: https://doi.org/10.1007/s40615-024-02132-8

2024-08-21

Journal of Racial and Ethnic Health Disparities

Abstract:Personal implicit biases may contribute to inequitable health outcomes, but the mechanisms of these effects are unclear at a system level. This study aimed to determine whether stigmatizing subjective terms in electronic medical records (EMR) reflect larger societal racial biases. A cross-sectional study was conducted using natural language processing software of all documentation where one or more predefined stigmatizing words were used between January 1, 2019 and June 30, 2021. EMR from emergency care and inpatient encounters in a metropolitan healthcare system were analyzed, focused on the presence or absence of race-based differences in word usage, either by specific terms or by groupings of negative or positive terms based on the common perceptions of the words. The persistence ("stickiness") of negative and/or positive characterizations in subsequent encounters for an individual was also evaluated. Final analyses included 12,238 encounters for 9135 patients, ranging from newborn to 104 years old. White (68%) vs Black/African American (17%) were the analyzed groups. Several negative terms (e.g., noncompliant, disrespectful, and curse words) were significantly more frequent in encounters with Black/African American patients. In contrast, positive terms (e.g., compliant, polite) were statistically more likely to be in White patients' documentation. Independent of race, negative characterizations were twice as likely to persist compared with positive ones in subsequent encounters. The use of stigmatizing language in documentation mirrors the same race-based inequities seen in medical outcomes and larger sociodemographic trends. This may contribute to observed healthcare outcome differences by disseminating one's implicit biases to unknown future healthcare providers.

public, environmental & occupational health
Classifying social determinants of health from unstructured electronic health records using deep learning-based natural language processing

Sifei Han,Robert F. Zhang,Lingyun Shi,Russell Richie,Haixia Liu,Andrew Tseng,Wei Quan,Neal Ryan,David Brent,Fuchiang R. Tsui

DOI: https://doi.org/10.1016/j.jbi.2021.103984

IF: 8

2022-03-01

Journal of Biomedical Informatics

Abstract:OBJECTIVE: Social determinants of health (SDOH) are non-medical factors that can profoundly impact patient health outcomes. However, SDOH are rarely available in structured electronic health record (EHR) data such as diagnosis codes, and more commonly found in unstructured narrative clinical notes. Hence, identifying social context from unstructured EHR data has become increasingly important. Yet, previous work on using natural language processing to automate extraction of SDOH from text (a) usually focuses on an ad hoc selection of SDOH, and (b) does not use the latest advances in deep learning. Our objective was to advance automatic extraction of SDOH from clinical text by (a) systematically creating a set of SDOH based on standard biomedical and psychiatric ontologies, and (b) training state-of-the-art deep neural networks to extract mentions of these SDOH from clinical notes.DESIGN: A retrospective cohort study.SETTING AND PARTICIPANTS: Data were extracted from the Medical Information Mart for Intensive Care (MIMIC-III) database. The corpus comprised 3,504 social related sentences from 2,670 clinical notes.METHODS: We developed a framework for automated classification of multiple SDOH categories. Our dataset comprised narrative clinical notes under the "Social Work" category in the MIMIC-III Clinical Database. Using standard terminologies, SNOMED-CT and DSM-IV, we systematically curated a set of 13 SDOH categories and created annotation guidelines for these. After manually annotating the 3,504 sentences, we developed and tested three deep neural network (DNN) architectures - convolutional neural network (CNN), long short-term memory (LSTM) network, and the Bidirectional Encoder Representations from Transformers (BERT) - for automated detection of eight SDOH categories. We also compared these DNNs to three baselines models: (1) cTAKES, as well as (2) L2-regularized logistic regression and (3) random forests on bags-of-words. Model evaluation metrics included micro- and macro- F1, and area under the receiver operating characteristic curve (AUC).RESULTS: All three DNN models accurately classified all SDOH categories (minimum micro-F1 = 0.632, minimum macro-AUC = 0.854). Compared to the CNN and LSTM, BERT performed best in most key metrics (micro-F1 = 0.690, macro-AUC = 0.907). The BERT model most effectively identified the "occupational" category (F1 = 0.774, AUC = 0.965) and least effectively identified the "non-SDOH" category (F = 0.491, AUC = 0.788). BERT outperformed cTAKES in distinguishing social vs non-social sentences (BERT F1 = 0.87 vs. cTAKES F1 = 0.06), and outperformed logistic regression (micro-F1 = 0.649, macro-AUC = 0.696) and random forest (micro-F1 = 0.502, macro-AUC = 0.523) trained on bag-of-words.CONCLUSIONS: Our study framework with DNN models demonstrated improved performance for efficiently identifying a systematic range of SDOH categories from clinical notes in the EHR. Improved identification of patient SDOH may further improve healthcare outcomes.

medical informatics,computer science, interdisciplinary applications
Enhancing Patient Experience by Automating and Transforming Free Text into Actionable Consumer Insights: A Natural Language Processing (NLP) Approach

Ela Vashishtha,Himanshu Kapoor

DOI: https://doi.org/10.52403/ijhsr.20231038

2023-10-26

International Journal of Health Sciences and Research

Abstract:Background: The digitalization of healthcare has expanded patient access to care delivery through various virtual platforms. These platforms accumulate a wealth of patient feedback data, offering valuable insights into care perception and experience. Natural Language Processing (NLP) provides a means to efficiently analyze this unstructured patient feedback, enabling healthcare organizations to enhance care quality and patient experience. Methods: This study collected 19,000 comments from diverse sources, including surveys and social media, spanning from January 1, 2018, to June 30, 2021. The data underwent preprocessing, including lowercase conversion, special character removal, and lemmatization. A "hot word" list was employed to identify critical patient safety concerns. NLP models, including sentiment analysis and text classification, were used to analyze patient feedback. Results: The sentiment analysis revealed that most patient comments were positive or neutral, with 34.5% positive, 52.6% negative, and 12.9% neutral sentiments. Aggregate analysis identified access and login issues as a primary source of dissatisfaction, with 78% of related comments expressing negativity. The study also utilized Word2Vec to uncover word associations, highlighting positive associations with "staff" and negative associations with "website" and "insurance." Hot word detection identified 580 comments requiring immediate attention for patient safety. Conclusions: NLP-enabled analysis of patient feedback offers actionable insights for healthcare organizations. It identifies areas for improvement, tracks sentiment trends, and aids in patient engagement. Additionally, NLP benefits research and development by accelerating drug discovery and improving healthcare outcomes. Despite limitations, NLP's role in healthcare data analysis is poised to grow, benefiting both providers and consumers. This study recommends proactive use of NLP tools to enhance care delivery and patient experience. Key words: Natural Language Processing, Context-aware Algorithms, Quality Improvement Framework, Text Classification, Electronic Health Records, Machine Learning, Word2Vec, Sentiment Analysis, Word2Vec, Hot Word List, Frequency Distribution, Patient Feedback.

An Inversion of the Obstacle Problem and its Explicit Solution

Cognitive-Behavioral Group Therapy versus Sertraline for Obsessive-Compulsive Disorder: Five-Year Follow-Up

Use of natural language processing to uncover racial bias in obstetrical documentation

[Cholestasis. Diagnostic value of immunoelectrophoresis].

CARE-SD: Classifier-based analysis for recognizing and eliminating stigmatizing and doubt marker labels in electronic health records: model development and validation

A Team Public Health Research Project for First-Year Pharmacy Students to Apply Content From Didactic Courses

Identifying and Characterizing Bias at Scale in Clinical Notes Using Large Language Models

Measuring Implicit Bias in ICU Notes Using Word-Embedding Neural Network Models

Secondary Qualitative Analysis of Stigmatizing and Nonstigmatizing Language Used in Hospital Birth Settings

NLP for Maternal Healthcare: Perspectives and Guiding Principles in the Age of LLMs

Classifying early infant feeding status from clinical notes using natural language processing and machine learning

Echoes of Biases: How Stigmatizing Language Affects AI Performance

Using Large Language Models to Annotate Complex Cases of Social Determinants of Health in Longitudinal Clinical Records

Natural Language Processing in Electronic Health Records in Relation to Healthcare Decision-making: A Systematic Review

In-hospital cardiac arrest: characteristics and outcome after implementation of systematic practice-oriented training.

Unveiling Disparities in Maternity Care: A Topic Modelling Approach to Analysing Maternity Incident Investigation Reports

Can natural language processing models extract and classify instances of interpersonal violence in mental healthcare electronic records: an applied evaluative study

The Power of Language in Hospital Care for Pregnant and Birthing People: A Vision for Change

Disparities in Documentation: Evidence of Race-Based Biases in the Electronic Medical Record

Classifying social determinants of health from unstructured electronic health records using deep learning-based natural language processing

Enhancing Patient Experience by Automating and Transforming Free Text into Actionable Consumer Insights: A Natural Language Processing (NLP) Approach