Modulation of 5-iodo-2'-deoxyuridine metabolism and cytotoxicity in human bladder cancer cells by fluoropyrimidines.

A. Benson,D. Trump,K. Cummings,P. Fischer

DOI: https://doi.org/10.1016/0006-2952(85)90446-0

IF: 6.1

1985-11-01

Biochemical Pharmacology

Abstract:

What problem does this paper attempt to address?

Development and Validation of a Deep Learning Model for Detection of Allergic Reactions Using Safety Event Reports Across Hospitals

Jie Yang,Liqin Wang,Neelam A. Phadke,Paige G. Wickner,Christian M. Mancini,Kimberly G. Blumenthal,Li Zhou

DOI: https://doi.org/10.1001/jamanetworkopen.2020.22836

2020-01-01

JAMA Network Open

Abstract:Importance:Although critical to patient safety, health care-related allergic reactions are challenging to identify and monitor.Objective:To develop a deep learning model to identify allergic reactions in the free-text narrative of hospital safety reports and evaluate its generalizability, efficiency, productivity, and interpretability.Design, Setting, and Participants:This cross-sectional study analyzed hospital safety reports filed between May 2004 and January 2019 at Brigham and Women's Hospital and between April 2006 and June 2018 at Massachusetts General Hospital in Boston. Training and validating a deep learning model involved extracting safety reports using 101 expert-curated keywords from Massachusetts General Hospital (data set I). The model was then evaluated on 3 data sets: reports without keywords (data set II), reports from a different time frame (data set III), and reports from a different hospital (Brigham and Women's Hospital; data set IV). Statistical analyses were performed between March 1, 2019, and July 18, 2020.Main Outcomes and Measures:The area under the receiver operating characteristic curve and area under the precision-recall curve were used on data set I. The precision at top-k was used on data sets II to IV.Results:A total of 299 028 safety reports with 172 854 patients were included. Of these patients, 86 544 were women (50.1%) and the median (interquartile range [IQR]) age was 59.7 (43.8-71.6) years. The deep learning model achieved an area under the receiver operating characteristic curve of 0.979 (95% CI, 0.973-0.985) and an area under the precision-recall curve of 0.809 (95% CI, 0.773-0.845). The model achieved precisions at the top 100 model-identified cases of 0.930 in data set II, 0.960 in data set III, and 0.990 in data set IV. Compared with the keyword-search approach, the deep learning model reduced the number of cases for manual review by 63.8% and identified 24.2% more cases of confirmed allergic reactions. The model highlighted important words (eg, rash, hives, and Benadryl) in prediction and extended the list of expert-curated keywords through an attention layer.Conclusions and Relevance:This study showed that a deep learning model can accurately and efficiently identify allergic reactions using free-text narratives written by a variety of health care professionals. This model could be used to improve allergy care, potentially enabling real-time event surveillance and guidance for medical errors and system improvement.
The effect of indigenous Neem Azadirachta indica [correction of (Adirachta indica)] mouth wash on Streptococcus mutans and lactobacilli growth.

Anita Vanka,S. Tandon,S. R. Rao,N. Udupa,P. Ramkumar

2001-07-01

Indian Journal of Dental Research

Abstract:Neem is one of the most widely researched tropical tree, with almost all it's parts being put for a variety of uses. In the present study, the antibacterial effect of Neem mouthwash against salivary levels of streptococcus mutans and lactobacillus has been tested over a period of 2 months. Also it's effect in reversing incipient carious lesions was assessed. While streptococcus mutans was inhibited by Neem mouthwashes, with or without alcohol as well as chlorhexidine, lactobacillus growth was inhibited by chlorhexidine alone. The initial data appears to prove it's effect in inhibiting S. mutans and reversing incipient carious lesions, longer term clinical trials are essential.
Benzothiadiazine dioxide dibenzyl derivatives as potent human cytomegalovirus inhibitors: synthesis and comparative molecular field analysis.

A. Martínez,C. Gil,M. I. Abasolo,A. Castro,A. M. Bruno,C. Pérez,C. Prieto,J. Otero

DOI: https://doi.org/10.1021/JM000033P

IF: 8.039

2000-08-09

Journal of Medicinal Chemistry

Abstract:The benzothiadiazine dioxide (BTD) derivatives are potent nonnucleoside human cytomegalovirus (HCMV) inhibitors. As part of our comprehensive structure-activity relationship study of these compounds, we have now synthesized N,N- and N,O-dibenzyl derivatives with different para-substituents (alkyl, phenyl, electron-donating, electron-withdrawing) in the phenyl ring of the benzyl moieties. The antiviral activity against HCMV (AD-169 strain) was also experimentally measured showing IC(50) values between 2.5 and 50 microM. Comparative molecular field analysis (CoMFA) was employed to generate a model, based upon 32 diverse BTD derivatives, to delineate structural and electrostatic features important for enhanced activity against HCMV. The steric (van der Waals) interactions with the receptor majoritary describes the variation in antiviral activity among the inhibitors. Finally, the CoMFA model was used to design two sets of novel BTD derivatives. Synthesis and subsequent anti-HCMV evaluation of these compounds enabled us to maintain the activity of this new kind of HCMV inhibitors.
Sorting Through the Safety Data Haystack: Using Machine Learning to Identify Individual Case Safety Reports in Social-Digital Media

Shaun Comfort,Sujan Perera,Zoe Hudson,Darren Dorrell,Shawman Meireis,Meenakshi Nagarajan,Cartic Ramakrishnan,Jennifer Fine

DOI: https://doi.org/10.1007/s40264-018-0641-7

Abstract:Introduction: There is increasing interest in social digital media (SDM) as a data source for pharmacovigilance activities; however, SDM is considered a low information content data source for safety data. Given that pharmacovigilance itself operates in a high-noise, lower-validity environment without objective 'gold standards' beyond process definitions, the introduction of large volumes of SDM into the pharmacovigilance workflow has the potential to exacerbate issues with limited manual resources to perform adverse event identification and processing. Recent advances in medical informatics have resulted in methods for developing programs which can assist human experts in the detection of valid individual case safety reports (ICSRs) within SDM. Objective: In this study, we developed rule-based and machine learning (ML) models for classifying ICSRs from SDM and compared their performance with that of human pharmacovigilance experts. Methods: We used a random sampling from a collection of 311,189 SDM posts that mentioned Roche products and brands in combination with common medical and scientific terms sourced from Twitter, Tumblr, Facebook, and a spectrum of news media blogs to develop and evaluate three iterations of an automated ICSR classifier. The ICSR classifier models consisted of sub-components to annotate the relevant ICSR elements and a component to make the final decision on the validity of the ICSR. Agreement with human pharmacovigilance experts was chosen as the preferred performance metric and was evaluated by calculating the Gwet AC1 statistic (gKappa). The best performing model was tested against the Roche global pharmacovigilance expert using a blind dataset and put through a time test of the full 311,189-post dataset. Results: During this effort, the initial strict rule-based approach to ICSR classification resulted in a model with an accuracy of 65% and a gKappa of 46%. Adding an ML-based adverse event annotator improved the accuracy to 74% and gKappa to 60%. This was further improved by the addition of an additional ML ICSR detector. On a blind test set of 2500 posts, the final model demonstrated a gKappa of 78% and an accuracy of 83%. In the time test, it took the final model 48 h to complete a task that would have taken an estimated 44,000 h for human experts to perform. Conclusion: The results of this study indicate that an effective and scalable solution to the challenge of ICSR detection in SDM includes a workflow using an automated ML classifier to identify likely ICSRs for further human SME review.
Developing A Deep Learning Natural Language Processing Algorithm For Automated Reporting Of Adverse Drug Reactions

Christopher McMaster,Julia Chan,David FL Liew,Elizabeth Su,Albert G Frauman,Wendy W Chapman,Douglas EV Pires

DOI: https://doi.org/10.1101/2021.12.11.21267504

2021-12-13

Abstract:Abstract The detection of adverse drug reactions (ADRs) is critical to our understanding of the safety and risk-benefit profile of medications. With an incidence that has not changed over the last 30 years, ADRs are a significant source of patient morbidity, responsible for 5-10% of acute care hospital admissions worldwide. Spontaneous reporting of ADRs has long been the standard method of reporting, however this approach is known to have high rates of under-reporting, a problem that limits pharmacovigilance efforts. Automated ADR reporting presents an alternative pathway to increase reporting rates, although this may be limited by over-reporting of other drug-related adverse events. We developed a deep learning natural language processing algorithm to identify ADRs in discharge summaries at a single academic hospital centre. Our model was developed in two stages: first, a pre-trained model (DeBERTa) was further pre-trained on 1.1 million unlabelled clinical documents; secondly, this model was fine-tuned to detect ADR mentions in a corpus of 861 annotated discharge summaries. This model was compared to a version without the pre-training step, and a model finetuned from the ClinicalBERT model, which has demonstrated state-of-the-art performance on other pharmacovigilance tasks. To ensure that our algorithm could differentiate ADRs from other drug-related adverse events, the annotated corpus was enriched for both validated ADR reports and confounding drug-related adverse events using. The final model demonstrated good performance with a ROC-AUC of 0.955 (95% CI 0.946 - 0.963) for the task of identifying discharge summaries containing ADR mentions, significantly outperforming the two comparator models.
Evaluation of a Natural Language Processing Approach to Identify Diagnostic Errors and Analysis of Safety Learning System Case Review Data: Retrospective Cohort Study

Azade Tabaie,Alberta Tran,Tony Calabria,Sonita S Bennett,Arianna Milicia,William Weintraub,William James Gallagher,John Yosaitis,Laura C Schubel,Mary A Hill,Kelly Michelle Smith,Kristen Miller

DOI: https://doi.org/10.2196/50935

2024-08-26

Abstract:Background: Diagnostic errors are an underappreciated cause of preventable mortality in hospitals and pose a risk for severe patient harm and increase hospital length of stay. Objective: This study aims to explore the potential of machine learning and natural language processing techniques in improving diagnostic safety surveillance. We conducted a rigorous evaluation of the feasibility and potential to use electronic health records clinical notes and existing case review data. Methods: Safety Learning System case review data from 1 large health system composed of 10 hospitals in the mid-Atlantic region of the United States from February 2016 to September 2021 were analyzed. The case review outcome included opportunities for improvement including diagnostic opportunities for improvement. To supplement case review data, electronic health record clinical notes were extracted and analyzed. A simple logistic regression model along with 3 forms of logistic regression models (ie, Least Absolute Shrinkage and Selection Operator, Ridge, and Elastic Net) with regularization functions was trained on this data to compare classification performances in classifying patients who experienced diagnostic errors during hospitalization. Further, statistical tests were conducted to find significant differences between female and male patients who experienced diagnostic errors. Results: In total, 126 (7.4%) patients (of 1704) had been identified by case reviewers as having experienced at least 1 diagnostic error. Patients who had experienced diagnostic error were grouped by sex: 59 (7.1%) of the 830 women and 67 (7.7%) of the 874 men. Among the patients who experienced a diagnostic error, female patients were older (median 72, IQR 66-80 vs median 67, IQR 57-76; P=.02), had higher rates of being admitted through general or internal medicine (69.5% vs 47.8%; P=.01), lower rates of cardiovascular-related admitted diagnosis (11.9% vs 28.4%; P=.02), and lower rates of being admitted through neurology department (2.3% vs 13.4%; P=.04). The Ridge model achieved the highest area under the receiver operating characteristic curve (0.885), specificity (0.797), positive predictive value (PPV; 0.24), and F1-score (0.369) in classifying patients who were at higher risk of diagnostic errors among hospitalized patients. Conclusions: Our findings demonstrate that natural language processing can be a potential solution to more effectively identifying and selecting potential diagnostic error cases for review and therefore reducing the case review burden.
Scalable incident detection via natural language processing and probabilistic language models

Colin G. Walsh,Drew Wilimitis,Qingxia Chen,Aileen Wright,Jhansi Kolli,Katelyn Robinson,Michael A. Ripperger,Kevin B. Johnson,David Carrell,Rishi J. Desai,Andrew Mosholder,Sai Dharmarajan,Sruthi Adimadhyam,Daniel Fabbri,Danijela Stojanovic,Michael E. Matheny,Cosmin A. Bejan

DOI: https://doi.org/10.1038/s41598-024-72756-7

IF: 4.6

2024-10-10

Scientific Reports

Abstract:Post marketing safety surveillance depends in part on the ability to detect concerning clinical events at scale. Spontaneous reporting might be an effective component of safety surveillance, but it requires awareness and understanding among healthcare professionals to achieve its potential. Reliance on readily available structured data such as diagnostic codes risks under-coding and imprecision. Clinical textual data might bridge these gaps, and natural language processing (NLP) has been shown to aid in scalable phenotyping across healthcare records in multiple clinical domains. In this study, we developed and validated a novel incident phenotyping approach using unstructured clinical textual data agnostic to Electronic Health Record (EHR) and note type. It's based on a published, validated approach (PheRe) used to ascertain social determinants of health and suicidality across entire healthcare records. To demonstrate generalizability, we validated this approach on two separate phenotypes that share common challenges with respect to accurate ascertainment: (1) suicide attempt; (2) sleep-related behaviors. With samples of 89,428 records and 35,863 records for suicide attempt and sleep-related behaviors, respectively, we conducted silver standard (diagnostic coding) and gold standard (manual chart review) validation. We showed Area Under the Precision-Recall Curve of ~ 0.77 (95% CI 0.75–0.78) for suicide attempt and AUPR ~ 0.31 (95% CI 0.28–0.34) for sleep-related behaviors. We also evaluated performance by coded race and demonstrated differences in performance by race differed across phenotypes. Scalable phenotyping models, like most healthcare AI, require algorithmovigilance and debiasing prior to implementation.

multidisciplinary sciences
Manganese Reduction by Microbes from Oxic Regions of the Lake Vanda (Antarctica) Water Column

B. Bratina,B. Stevenson,W. Green,T. Schmidt

DOI: https://doi.org/10.1128/AEM.64.10.3791-3797.1998

1998-10-01

Applied and Environmental Microbiology

Abstract:ABSTRACT Depth profiles of metals in Lake Vanda, a permanently ice-covered, stratified Antarctic lake, suggest the importance of particulate manganese oxides in the scavenging, transport, and release of metals. Since manganese oxides can be solubilized by manganese-reducing bacteria, microbially mediated manganese reduction was investigated in Lake Vanda. Microbes concentrated from oxic regions of the water column, encompassing a peak of soluble manganese [Mn(II)], reduced synthetic manganese oxides (MnO2) when incubated aerobically. Pure cultures of manganese-reducing bacteria were readily isolated from waters collected near the oxic Mn(II) peak. Based on phylogenetic analysis of the 16S rRNA gene sequence, most of the isolated manganese reducers belong to the genusCarnobacterium. Cultures of a phylogenetically representative strain of Carnobacterium reduced synthetic MnO2 in the presence of sodium azide, as was seen in field assays. Unlike anaerobes that utilize manganese oxides as terminal electron acceptors in respiration, isolates of the genusCarnobacterium reduced Mn(IV) via a diffusible compound under oxic conditions. The release of adsorbed trace metals accompanying the solubilization of manganese oxides may provide populations of Carnobacterium with a source of nutrients in this extremely oligotrophic environment.
Automated validation of patient safety clinical incident classification: macro analysis

Jaiprakash Gupta,Jon Patrick

Abstract:Patient safety is the buzz word in healthcare. Incident Information Management System (IIMS) is electronic software that stores clinical mishaps narratives in places where patients are treated. It is estimated that in one state alone over one million electronic text documents are available in IIMS. In this paper we investigate the data density available in the fields entered to notify an incident and the validity of the built in classification used by clinician to categories the incidents. Waikato Environment for Knowledge Analysis (WEKA) software was used to test the classes. Four statistical classifier based on J48, Naïve Bayes (NB), Naïve Bayes Multinominal (NBM) and Support Vector Machine using radial basis function (SVM_RBF) algorithms were used to validate the classes. The data pool was 10,000 clinical incidents drawn from 7 hospitals in one state in Australia. In first part of the study 1000 clinical incidents were selected to determine type and number of fields worth investigating and in the second part another 5448 clinical incidents were randomly selected to validate 13 clinical incident types. Result shows 74.6% of the cells were empty and only 23 fields had content over 70% of the time. The percentage correctly classified classes on four algorithms using categorical dataset ranged from 42 to 49%, using free-text datasets from 65% to 77% and using both datasets from 72% to 79%. Kappa statistic ranged from 0.36 to 0.4. for categorical data, from 0.61 to 0.74. for free-text and from 0.67 to 0.77 for both datasets. Similar increases in performance in the 3 experiments was noted on true positive rate, precision, F-measure and area under curve (AUC) of receiver operating characteristics (ROC) scores. The study demonstrates only 14 of 73 fields in IIMS have data that is usable for machine learning experiments. Irrespective of the type of algorithms used when all datasets are used performance was better. Classifier NBM showed best performance. We think the classifier can be improved further by reclassifying the most confused classes and there is scope to apply text mining tool on patient safety classifications.
Validation of a natural language processing algorithm using national reporting data to improve identification of anesthesia-related ADVerse evENTs: The "ADVENTURE" study

Paul M Mertes,Claire Morgand,Paul Barach,Geoffrey Jurkolow,Karen E Assmann,Edouard Dufetelle,Vincent Susplugas,Bilal Alauddin,Patrick Georges Yavordios,Jean Tourres,Jean-Marc Dumeix,Xavier Capdevila

DOI: https://doi.org/10.1016/j.accpm.2024.101390

Abstract:Background: Reporting and analysis of adverse events (AE) is associated with improved health system learning, quality outcomes, and patient safety. Manual text analysis is time-consuming, costly, and prone to human errors. We aimed to demonstrate the feasibility of novel machine learning and natural language processing (NLP) approaches for early predictions of adverse events and provide input to direct quality improvement and patient safety initiatives. Methods: We used machine learning to analyze 9559 continuously reported AE by clinicians and healthcare systems to the French National Health accreditor (HAS) between January 1, 2009, and December 31, 2020 . We validated the labeling of 135,000 unique de-identified AE reports and determined the associations between different system's root causes and patient consequences. The model was validated by independent expert anesthesiologists. Results: The machine learning (ML) and Artificial Intelligence (AI) model trained on 9559 AE datasets accurately categorized 8800 (88%) of reported AE. The three most frequent AE types were "difficult orotracheal intubation" (16.9% of AE reports), "medication error" (10.5%), and "post-induction hypotension" (6.9%). The accuracy of the AI model reached 70.9% sensitivity, 96.6% specificity for "difficult intubation", 43.2% sensitivity, and 98.9% specificity for "medication error." Conclusions: This unsupervised ML method provides an accurate, automated, AI-supported search algorithm that ranks and helps to understand complex risk patterns and has greater speed, precision, and clarity when compared to manual human data extraction. Machine learning and Natural language processing (NLP) models can effectively be used to process natural language AE reports and augment expert clinician input. This model can support clinical applications and methodological standards and used to better inform and enhance decision-making for improved risk management and patient safety. Trial registration: The study was approved by the ethics committee of the French Society of Anesthesiology (IRB 00010254-2020-20) and the CNIL (CNIL: 118 58 95) and the study was registered with ClinicalTrials.gov (NCT: NCT05185479).
Exploring opportunities for AI supported medication error categorization: A brief report in human machine collaboration

Allan Fong,Christopher Bonk,Varvara Vasilchenko,Suranjan De,Douglas Kovich,Jo Wyeth

DOI: https://doi.org/10.3389/fdsfr.2022.1021068

2022-11-10

Frontiers in Drug Safety and Regulation

Abstract:Understanding and mitigating medication errors is critical for ensuring patient safety and improving patient care. Correctly identifying medication errors in the United States Food and Drug Administration (FDA) Adverse Event Reporting System (FAERS) reports can be difficult because of the complexities of medication error concepts. We took a user-centered design approach to support the medication error categorization workflow process with artificial intelligence (AI). We developed machine learning models to categorize medication error terms. The average F1-score, precision, recall, and area under the precision recall curve for 18 Medical Dictionary for Regulatory Activities (MedDRA) Lower Level Term (LLT) relating to medication errors were 0.88, 0.92. 0.85, and 0.83 respectively. We developed a framework to help evaluate opportunities for artificial intelligence integration in the medication error categorization workflow. The framework has four attributes: technical deployment, process rigidity, AI assistance, and frequency. We used the framework to compare two AI integration opportunities and concluded that the quality assurance (QA) opportunity to be a more feasible initial option for AI integration. We then extended these insights into the development and user testing of a prototype application. The user testing identified the highlighting and commenting capabilities of the application to be more useful and sliders and similar report suggestions to be less useful. This suggested that different AI interactions with human highlighting should be explored. While the medication error quality assurance prototype application was developed for supporting the review of direct FAERS reports, this approach can be extended to assist in the workflow for all FAERS reports.
Semi-Supervised Natural Language Approach for Fine-Grained Classification of Medical Reports

Neil Deshmukh,Selin Gumustop,Romane Gauriau,Varun Buch,Bradley Wright,Christopher Bridge,Ram Naidu,Katherine Andriole,Bernardo Bizzo

DOI: https://doi.org/10.48550/arXiv.1910.13573

2019-11-14

Abstract:Although machine learning has become a powerful tool to augment doctors in clinical analysis, the immense amount of labeled data that is necessary to train supervised learning approaches burdens each development task as time and resource intensive. The vast majority of dense clinical information is stored in written reports, detailing pertinent patient information. The challenge with utilizing natural language data for standard model development is due to the complex nature of the modality. In this research, a model pipeline was developed to utilize an unsupervised approach to train an encoder-language model, a recurrent network, to generate document encodings; which then can be used as features passed into a decoder-classifier model that requires magnitudes less labeled data than previous approaches to differentiate between fine-grained disease classes accurately. The language model was trained on unlabeled radiology reports from the Massachusetts General Hospital Radiology Department (n=218,159) and terminated with a loss of 1.62. The classification models were trained on three labeled datasets of head CT studies of reported patients, presenting large vessel occlusion (n=1403), acute ischemic strokes (n=331), and intracranial hemorrhage (n=4350), to identify a variety of different findings directly from the radiology report data; resulting in AUCs of 0.98, 0.95, and 0.99, respectively, for the large vessel occlusion, acute ischemic stroke, and intracranial hemorrhage datasets. The output encodings are able to be used in conjunction with imaging data, to create models that can process a multitude of different modalities. The ability to automatically extract relevant features from textual data allows for faster model development and integration of textual modality, overall, allowing clinical reports to become a more viable input for more encompassing and accurate deep learning models.

Machine Learning,Computation and Language
A pre-trained language model for emergency department intervention prediction using routine physiological data and clinical narratives

Ting-Yun Huang,Chee-Fah Chong,Heng-Yu Lin,Tzu-Ying Chen,Yung-Chun Chang,Ming-Chin Lin

DOI: https://doi.org/10.1016/j.ijmedinf.2024.105564

Abstract:Introduction: The urgency and complexity of emergency room (ER) settings require precise and swift decision-making processes for patient care. Ensuring the timely execution of critical examinations and interventions is vital for reducing diagnostic errors, but the literature highlights a need for innovative approaches to optimize diagnostic accuracy and patient outcomes. In response, our study endeavors to create predictive models for timely examinations and interventions by leveraging the patient's symptoms and vital signs recorded during triage, and in so doing, augment traditional diagnostic methodologies. Methods: Focusing on four key areas-medication dispensing, vital interventions, laboratory testing, and emergency radiology exams, the study employed Natural Language Processing (NLP) and seven advanced machine learning techniques. The research was centered around the innovative use of BioClinicalBERT, a state-of-the-art NLP framework. Results: BioClinicalBERT emerged as the superior model, outperforming others in predictive accuracy. The integration of physiological data with patient narrative symptoms demonstrated greater effectiveness compared to models based solely on textual data. The robustness of our approach was confirmed by an Area Under the Receiver Operating Characteristic curve (AUROC) score of 0.9. Conclusion: The findings of our study underscore the feasibility of establishing a decision support system for emergency patients, targeting timely interventions and examinations based on a nuanced analysis of symptoms. By using an advanced natural language processing technique, our approach shows promise for enhancing diagnostic accuracy. However, the current model is not yet fully mature for direct implementation into daily clinical practice. Recognizing the imperative nature of precision in the ER environment, future research endeavors must focus on refining and expanding predictive models to include detailed timely examinations and interventions. Although the progress achieved in this study represents an encouraging step towards a more innovative and technology-driven paradigm in emergency care, full clinical integration warrants further exploration and validation.
Machine learning algorithm to perform ASA Physical Status Classification

Alexander Pozhitkov,Naini Seth,Trilokesh D. Kidambi,John Raytis,Srisairam Achuthan,Michael W. Lew

DOI: https://doi.org/10.1101/2021.10.05.21264585

2021-10-07

Abstract:Abstract Background The American Society of Anesthesiologists (ASA) Physical Status Classification System defines peri-operative patient scores as 1 (healthy) thru 6 (brain dead). The scoring is used by the anesthesiologists to classify surgical patients based on co-morbidities and various clinical characteristics. The classification is always done by an anesthesiologist prior operation. There is a variability in scoring stemming from individual experiences / biases of the scoring anesthesiologists, which impacts prediction of operating times, length of stay in the hospital, necessity of blood transfusion, etc. In addition, the score affects anesthesia coding and billing. It is critical to remove subjectivity from the process to achieve reproducible generalizable scoring. Methods A machine learning (ML) approach was used to associate assigned ASA scores with peri-operative patients’ clinical characteristics. More than ten ML algorithms were simultaneously trained, validated, and tested with retrospective records. The most accurate algorithm was chosen for a subsequent test on an independent dataset. DataRobot platform was used to run and select the ML algorithms. Manual scoring was also performed by one anesthesiologist. Intra-class correlation coefficient (ICC) was calculated to assess the consistency of scoring Results Records of 19,095 procedures corresponding to 12,064 patients with assigned ASA scores by 17 City of Hope anesthesiologists were used to train a number of ML algorithms (DataRobot platform). The most accurate algorithm was tested with independent records of 2325 procedures corresponding to 1999 patients. In addition, 86 patients from the same dataset were scored manually. The following ICC values were computed: COH anesthesiologists vs. ML – 0.427 (fair); manual vs. ML – 0.523 (fair-to-good); manual vs. COH anesthesiologists – 0.334 (poor). Conclusions We have shown the feasibility of using ML for assessing the ASA score. In principle, a group of experts ( i . e . physicians, institutions, etc .) can train the ML algorithm such that individual experiences and biases would cancel each leaving the objective ASA score intact. As more data are being collected, a valid foundation for refinement to the ML will emerge.
[Serotonin edema in rats and the influence of antiphlogistics].

W. Theobald,R. Domenjoz

Abstract:
Contextualizing injury severity from occupational accident reports using an optimized deep learning prediction model

Mohamed Zul Fadhli Khairuddin,Suresh Sankaranarayanan,Khairunnisa Hasikin,Nasrul Anuar Abd Razak,Rosidah Omar

DOI: https://doi.org/10.7717/peerj-cs.1985

2024-04-17

PeerJ Computer Science

Abstract:Background This study introduced a novel approach for predicting occupational injury severity by leveraging deep learning-based text classification techniques to analyze unstructured narratives. Unlike conventional methods that rely on structured data, our approach recognizes the richness of information within injury narrative descriptions with the aim of extracting valuable insights for improved occupational injury severity assessment. Methods Natural language processing (NLP) techniques were harnessed to preprocess the occupational injury narratives obtained from the US Occupational Safety and Health Administration (OSHA) from January 2015 to June 2023. The methodology involved meticulous preprocessing of textual narratives to standardize text and eliminate noise, followed by the innovative integration of Term Frequency-Inverse Document Frequency (TF-IDF) and Global Vector (GloVe) word embeddings for effective text representation. The proposed predictive model adopts a novel Bidirectional Long Short-Term Memory (Bi-LSTM) architecture and is further refined through model optimization, including random search hyperparameters and in-depth feature importance analysis. The optimized Bi-LSTM model has been compared and validated against other machine learning classifiers which are naïve Bayes, support vector machine, random forest, decision trees, and K-nearest neighbor. Results The proposed optimized Bi-LSTM models’ superior predictability, boasted an accuracy of 0.95 for hospitalization and 0.98 for amputation cases with faster model processing times. Interestingly, the feature importance analysis revealed predictive keywords related to the causal factors of occupational injuries thereby providing valuable insights to enhance model interpretability. Conclusion Our proposed optimized Bi-LSTM model offers safety and health practitioners an effective tool to empower workplace safety proactive measures, thereby contributing to business productivity and sustainability. This study lays the foundation for further exploration of predictive analytics in the occupational safety and health domain.

computer science, information systems, artificial intelligence, theory & methods
Comparing human text classification performance and explainability with large language and machine learning models using eye-tracking

Jeevithashree Divya Venkatesh,Aparajita Jaiswal,Gaurav Nanda

DOI: https://doi.org/10.1038/s41598-024-65080-7

IF: 4.6

2024-06-23

Scientific Reports

Abstract:To understand the alignment between reasonings of humans and artificial intelligence (AI) models, this empirical study compared the human text classification performance and explainability with a traditional machine learning (ML) model and large language model (LLM). A domain-specific noisy textual dataset of 204 injury narratives had to be classified into 6 cause-of-injury codes. The narratives varied in terms of complexity and ease of categorization based on the distinctive nature of cause-of-injury code. The user study involved 51 participants whose eye-tracking data was recorded while they performed the text classification task. While the ML model was trained on 120,000 pre-labelled injury narratives, LLM and humans did not receive any specialized training. The explainability of different approaches was compared based on the top words they used for making classification decision. These words were identified using eye-tracking for humans, explainable AI approach LIME for ML model, and prompts for LLM. The classification performance of ML model was observed to be relatively better than zero-shot LLM and non-expert humans, overall, and particularly for narratives with high complexity and difficult categorization. The top-3 predictive words used by ML and LLM for classification agreed with humans to a greater extent as compared to later predictive words.

multidisciplinary sciences
Development and Evaluation of Machine Learning Models for the Detection of Emergency Department Patients with Opioid Misuse from Clinical Notes

Usman Shahid,Natalie Parde,Dale L Smith,Grayson Dickinson,Joseph Bianco,Dillon Thorpe,Madhav Hota,Majid Afshar,Niranjan S Karnik,neeraj chhabra

DOI: https://doi.org/10.1101/2024.12.11.24318875

2024-12-12

Abstract:Objectives The accurate identification of Emergency Department (ED) encounters involving opioid misuse is critical for health services, research, and surveillance. We sought to develop natural language processing (NLP)-based models for the detection of ED encounters involving opioid misuse. Methods A sample of ED encounters enriched for opioid misuse was manually annotated and clinical notes extracted. We evaluated classic machine learning (ML) methods, fine-tuning of publicly available pretrained language models, and a previously developed convolutional neural network opioid classifier for use on hospitalized patients (SMART-AI). Performance was compared to ICD-10-CM codes. Both raw text and text transformed to the United Medical Language System were evaluated. Face validity was evaluated by term feature importance. Results There were 1123 encounters used for training, validation, and testing. Of the classic ML methods, XGBoost had the highest AU_PRC (0.936), accuracy (0.887), and F1 score (0.863) which outperformed ICD-10-CM codes [accuracy 0.870; F1 0.830]. Logistic regression, support vector machine, and XGBoost models had higher AU_PRC using transformed text, while decision trees performed better using raw text. Excluding XGBoost, fine-tuned pre-trained language models outperformed classic ML methods. The best performing model was the fine-tuned SMART-AI based model with domain adaptation [AU_PRC 0.948; accuracy 0.882; F1 0.851]. Explainability analyses showed the most predictive terms were "heroin", "opioids", "alcoholic intoxication, chronic", "cocaine", "opiates", and "suboxone". Conclusions NLP-based models outperform entry of ICD-10-CM diagnosis codes for the detection of ED encounters with opioid misuse. Fine tuning with domain adaptation for pre-trained language models resulted in improved performance.
Integrating machine learning predictions for perioperative risk management: Towards an empirical design of a flexible-standardized risk assessment tool

Joanna Abraham,Brian Bartek,Alicia Meng,Christopher Ryan King,Bing Xue,Chenyang Lu,Michael S. Avidan

DOI: https://doi.org/10.1016/j.jbi.2022.104270

IF: 8

2023-01-01

Journal of Biomedical Informatics

Abstract:BACKGROUND: Surgical patients are complex, vulnerable, and prone to postoperative complications that can potentially be mitigated with quality perioperative risk assessment and management. Several institutions have incorporated machine learning (ML) into their patient care to improve awareness and support clinician decision-making along the perioperative spectrum. Recent research suggests that ML risk prediction can support perioperative patient risk monitoring and management across several situations, including the operating room (OR) to intensive care unit (ICU) handoffs.OBJECTIVES: Our study objectives were threefold: (1) evaluate whether ML-generated postoperative predictions are concordant with clinician-generated risk rankings for acute kidney injury, delirium, pneumonia, deep vein thrombosis, and pulmonary embolism, and establish their associated risk factors; (2) ascertain clinician end-user suggestions to improve adoption of ML-generated risks and their integration into the perioperative workflow; and (3) develop a user-friendly visualization format for a tool to display ML-generated risks and risk factors to support postoperative care planning, for example, within the context of OR-ICU handoffs.METHODS: Graphical user interfaces for postoperative risk prediction models were assessed for end-user usability through cognitive walkthroughs and interviews with anesthesiologists, surgeons, certified registered nurse anesthetists, registered nurses, and critical care physicians. Thematic analysis relying on an explanation design framework was used to identify feedback and suggestions for improvement.RESULTS: 17 clinicians participated in the evaluation. ML estimates of complication risks aligned with clinicians' independent rankings, and related displays were perceived as valuable for decision-making and care planning for postoperative care. During OR-ICU handoffs, the tool could speed up report preparation and remind clinicians to address patient-specific complications, thus providing more tailored care information. Suggestions for improvement centered on electronic tool delivery; methods to build trust in ML models; modifiable risks and risk mitigation strategies; and additional patient information based on individual preferences (e.g., surgical procedure).CONCLUSIONS: ML estimates of postoperative complication risks can provide anticipatory guidance, potentially increasing the efficiency of care planning. We have offered an ML visualization framework for designing future ML-augmented tools and anticipate the development of tools that recommend specific actions to the user based on ML model output.

medical informatics,computer science, interdisciplinary applications
Comparative Analysis of Machine Learning Algorithms for Computer-Assisted Reporting Based on Fully Automated Cross-Lingual RadLex® Mappings

Máté E. Maros,Chang Gyu Cho,Andreas G. Junge,Benedikt Kämpgen,Victor Saase,Fabian Siegel,Frederik Trinkmann,Thomas Ganslandt,Holger Wenz

DOI: https://doi.org/10.20944/preprints202004.0354.v1

2020-04-20

Abstract:Objectives: Studies evaluating machine learning (ML) algorithms on cross-lingual RadLex® mappings for developing context-sensitive radiological reporting tools are lacking. Therefore, we investigated whether ML-based approaches can be utilized to assist radiologists in providing key imaging biomarkers – such as The Alberta stroke programme early CT score (APECTS). Material and Methods: A stratified random sample (age, gender, year) of CT reports (n=206) with suspected ischemic stroke was generated out of 3997 reports signed off between 2015-2019. Three independent, blinded readers assessed these reports and manually annotated clinico-radiologically relevant key features. The primary outcome was whether ASPECTS should have been provided (yes/no: 154/52). For all reports, both the findings and impressions underwent cross-lingual (German to English) RadLex®-mappings using natural language processing. Well-established ML-algorithms including classification trees, random forests, elastic net, support vector machines (SVMs) and boosted trees were evaluated in a 5 x 5-fold nested cross-validation framework. Further, a linear classifier (fastText) was directly fitted on the German reports. Ensemble learning was used to provide robust importance rankings of these ML-algorithms. Performance was evaluated using derivates of the confusion matrix and metrics of calibration including AUC, brier score and log loss as well as visually by calibration plots. Results: On this imbalanced classification task SVMs showed the highest accuracies both on human-extracted- (87%) and fully automated RadLex® features (findings: 82.5%; impressions: 85.4%). FastText without pre-trained language model showed the highest accuracy (89.3%) and AUC (92%) on the impressions. Ensemble learner revealed that boosted trees, fastText and SVMs are the most important ML-classifiers. Boosted trees fitted on the findings showed the best overall calibration curve. Conclusions: Contextual ML-based assistance suggesting ASPECTS while reporting neuroradiological emergencies is feasible, even if ML-models are restricted to be developed on limited and highly imbalanced data sets.

Modulation of 5-iodo-2'-deoxyuridine metabolism and cytotoxicity in human bladder cancer cells by fluoropyrimidines.

Development and Validation of a Deep Learning Model for Detection of Allergic Reactions Using Safety Event Reports Across Hospitals

The effect of indigenous Neem Azadirachta indica [correction of (Adirachta indica)] mouth wash on Streptococcus mutans and lactobacilli growth.

Benzothiadiazine dioxide dibenzyl derivatives as potent human cytomegalovirus inhibitors: synthesis and comparative molecular field analysis.

Sorting Through the Safety Data Haystack: Using Machine Learning to Identify Individual Case Safety Reports in Social-Digital Media

Developing A Deep Learning Natural Language Processing Algorithm For Automated Reporting Of Adverse Drug Reactions

Evaluation of a Natural Language Processing Approach to Identify Diagnostic Errors and Analysis of Safety Learning System Case Review Data: Retrospective Cohort Study

Scalable incident detection via natural language processing and probabilistic language models

Manganese Reduction by Microbes from Oxic Regions of the Lake Vanda (Antarctica) Water Column

Automated validation of patient safety clinical incident classification: macro analysis

Validation of a natural language processing algorithm using national reporting data to improve identification of anesthesia-related ADVerse evENTs: The "ADVENTURE" study

Exploring opportunities for AI supported medication error categorization: A brief report in human machine collaboration

Semi-Supervised Natural Language Approach for Fine-Grained Classification of Medical Reports

A pre-trained language model for emergency department intervention prediction using routine physiological data and clinical narratives

Machine learning algorithm to perform ASA Physical Status Classification

[Serotonin edema in rats and the influence of antiphlogistics].

Contextualizing injury severity from occupational accident reports using an optimized deep learning prediction model

Comparing human text classification performance and explainability with large language and machine learning models using eye-tracking

Development and Evaluation of Machine Learning Models for the Detection of Emergency Department Patients with Opioid Misuse from Clinical Notes

Integrating machine learning predictions for perioperative risk management: Towards an empirical design of a flexible-standardized risk assessment tool

Comparative Analysis of Machine Learning Algorithms for Computer-Assisted Reporting Based on Fully Automated Cross-Lingual RadLex® Mappings