Postinduction apnoea in dogs premedicated with acepromazine or dexmedetomidine and anaesthetized with alfaxalone or propofol.

Sarah E Bigby,T. Beths,S. Bauquier,J. E. Carter

DOI: https://doi.org/10.1016/j.vaa.2016.10.004

IF: 1.763

2017-09-01

Veterinary Anaesthesia and Analgesia

Abstract:

What problem does this paper attempt to address?

A Large Language Model to Detect Negated Expressions in Radiology Reports

Yvonne Su,Yonatan B Babore,Charles E Kahn Jr

DOI: https://doi.org/10.1007/s10278-024-01274-9

2024-09-25

Abstract:Natural language processing (NLP) is crucial to extract information accurately from unstructured text to provide insights for clinical decision-making, quality improvement, and medical research. This study compared the performance of a rule-based NLP system and a medical-domain transformer-based model to detect negated concepts in radiology reports. Using a corpus of 984 de-identified radiology reports from a large U.S.-based academic health system (1000 consecutive reports, excluding 16 duplicates), the investigators compared the rule-based medspaCy system and the Clinical Assertion and Negation Classification Bidirectional Encoder Representations from Transformers (CAN-BERT) system to detect negated expressions of terms from RadLex, the Unified Medical Language System Metathesaurus, and the Radiology Gamuts Ontology. Power analysis determined a sample size of 382 terms to achieve α = 0.05 and β = 0.8 for McNemar's test; based on an estimate of 15% negated terms, 2800 randomly selected terms were annotated manually as negated or not negated. Precision, recall, and F1 of the two models were compared using McNemar's test. Of the 2800 terms, 387 (13.8%) were negated. For negation detection, medspaCy attained a recall of 0.795, precision of 0.356, and F1 of 0.492. CAN-BERT achieved a recall of 0.785, precision of 0.768, and F1 of 0.777. Although recall was not significantly different, CAN-BERT had significantly better precision (χ2 = 304.64; p < 0.001). The transformer-based CAN-BERT model detected negated terms in radiology reports with high precision and recall; its precision significantly exceeded that of the rule-based medspaCy system. Use of this system will improve data extraction from textual reports to support information retrieval, AI model training, and discovery of causal relationships.
A finite-state automata based negation detection algorithm for Chinese clinical documents

Zheng Jia,Haomin Li,Meizhi Ju,Yinsheng Zhang

DOI: https://doi.org/10.1109/PIC.2014.6972310

2014-01-01

Abstract:In this paper we described an algorithm called NegDetector for locating concerned clinical terms mentioned in electronic narrative text clinical documents and detecting whether the particular terms appeared in different positions are negated or affirmed. The algorithm infers the status of a condition with regard to the property from simple lexical clues occurring in the context of condition, maybe more than a few words away from the term. Considering the diverse types of negative structures, this paper selects typical, common and recognizable usage patterns of negatives as criteria of judgment. The judging results during one complete process are driven by many different types of symbols, and the response to a particular symbol depends on the sequence of previous judging results. In this situation, the finite-state automata is useful to address lots of symbols that trigger one another. When evaluating NegDetector with testing case history, we measured a recall of 0.9985, a precision of 0.9498 and a fallout of 0.5147.
Non-Participation in a Randomized Controlled Trial: The Effect on Clinical and Non-Clinical Variables

J. H. Vermaire,C. van Loveren,J. Poorterman,J. Hoogstraten

DOI: https://doi.org/10.1159/000325742

2011-05-12

Caries Research

Abstract:Studies reporting clinical and non-clinical parameters of participants and non-participants of clinical trials are scarce. In the available studies non-participants were likely to show less favourable outcomes than participants on both socioeconomic parameters as well as on caries experience. However, the impact of non-participation on the total sample of the research population is not established. In the present study, as part of baseline data collection for a randomized controlled trial on caries-preventive strategies, 346 parents of children 6.0 years (± 3 months) of age were approached to let their child participate. Sixty parents refused, but 56 of them were willing to fill out the same set of questionnaires and to allow their child to be clinically examined once. Parents from participating children had higher socioeconomic status, were more often of autochthonous origin and scored better on knowledge questions than parents of non-participating children. Furthermore, parents of participating children reported a higher willingness to invest, were more likely to hold on to regular meals and their child had lower levels of plaque compared to non-participating children. Surprisingly, the participating children had higher dmfs scores than the non-participating children. Their care index (fs/ds + fs) was higher than that of non-participating children. Based on the findings of this study, the presumption that non-participating children will show less favourable clinical outcomes cannot be supported. Although participants differed from non-participants, they did not differ from the total population. It is suggested that the external validity of a randomized controlled trial on caries-preventive strategies is not necessarily affected by non-participation bias.
The effect of associative strength on priming in the cerebral hemispheres

J. Coney

DOI: https://doi.org/10.1016/S0278-2626(02)00507-9

IF: 2.682

2002-11-01

Brain and Cognition

Abstract:
Evaluation of a BERT Natural Language Processing Model for Automating CT and MRI Triage and Protocol Selection

Jason Yao,Abdullah Alabousi,Oleg Mironov

DOI: https://doi.org/10.1177/08465371241255895

2024-06-06

Canadian Association of Radiologists Journal

Abstract:Canadian Association of Radiologists Journal, Ahead of Print. Purpose: To evaluate the accuracy of a Bidirectional Encoder Representations for Transformers (BERT) Natural Language Processing (NLP) model for automating triage and protocol selection of cross-sectional image requisitions. Methods: A retrospective study was completed using 222 392 CT and MRI studies from a single Canadian university hospital database (January 2018-September 2022). Three hundred unique protocols (116 CT and 184 MRI) were included. A BERT model was trained, validated, and tested using an 80%-10%-10% stratified split. Naive Bayes (NB) and Support Vector Machine (SVM) machine learning models were used as comparators. Models were assessed using F1 score, precision, recall, and area under the receiver operating characteristic curve (AUROC). The BERT model was also assessed for multi-class protocol suggestion and subgroups based on referral location, modality, and imaging section. Results: BERT was superior to SVM for protocol selection (F1 score: BERT-0.901 vs SVM-0.881). However, was not significantly different from SVM for triage prediction (F1 score: BERT-0.844 vs SVM-0.845). Both models outperformed NB for protocol and triage. BERT had superior performance on minority classes compared to SVM and NB. For multiclass prediction, BERT accuracy was up to 0.991 for top-5 protocol suggestion, and 0.981 for top-2 triage suggestion. Emergency department patients had the highest F1 scores for both protocol (0.957) and triage (0.986), compared to inpatients and outpatients. Conclusion: The BERT NLP model demonstrated strong performance in automating the triage and protocol selection of radiology studies, showing potential to enhance radiologist workflows. These findings suggest the feasibility of using advanced NLP models to streamline radiology operations.

radiology, nuclear medicine & medical imaging
Implementing engineering education on the WWW: 3 case studies

C. Gale,J. Bourne,M. Dawant,D. Quinn

Abstract:
Deep neural models for automated multi-task diagnostic scan management—quality enhancement, view classification and report generation

Karthik K,Sowmya Kamath S

DOI: https://doi.org/10.1088/2057-1976/ac3add

2021-11-30

Abstract:Abstract The detailed physiological perspectives captured by medical imaging provides actionable insights to doctors to manage comprehensive care of patients. However, the quality of such diagnostic image modalities is often affected by mismanagement of the image capturing process by poorly trained technicians and older/poorly maintained imaging equipment. Further, a patient is often subjected to scanning at different orientations to capture the frontal, lateral and sagittal views of the affected areas. Due to the large volume of diagnostic scans performed at a modern hospital, adequate documentation of such additional perspectives is mostly overlooked, which is also an essential key element of quality diagnostic systems and predictive analytics systems. Another crucial challenge affecting effective medical image data management is that the diagnostic scans are essentially stored as unstructured data, lacking a well-defined processing methodology for enabling intelligent image data management for supporting applications like similar patient retrieval , automated disease prediction etc. One solution is to incorporate automated diagnostic image descriptions of the observation/findings by leveraging computer vision and natural language processing. In this work, we present multi-task neural models capable of addressing these critical challenges. We propose ESRGAN, an image enhancement technique for improving the quality and visualization of medical chest x-ray images, thereby substantially improving the potential for accurate diagnosis, automatic detection and region-of-interest segmentation. We also propose a CNN-based model called ViewNet for predicting the view orientation of the x-ray image and generating a medical report using Xception net, thus facilitating a robust medical image management system for intelligent diagnosis applications. Experimental results are demonstrated using standard metrics like BRISQUE, PIQE and BLEU scores, indicating that the proposed models achieved excellent performance. Further, the proposed deep learning approaches enable diagnosis in a lesser time and their hybrid architecture shows significant potential for supporting many intelligent diagnosis applications.
Improving mentoring for women in computer science fields (abstract)

V. Almstrum,A. Borg,J. Paul Myers

DOI: https://doi.org/10.1145/169073.169521

1993-04-01

Abstract:Can having a mentor influence the likelihood that a woman will succeed in establishing a career in computer science? A number of studies and reports suggest that an effective mentoring relationship can, indeed, make a difference in attracting women to academic and industrial careers in computer science and then keeping them in the field. For example, in the report “Becoming a Computer Scientist (Pearl, et al, 1990), the shortage of female mentors and role models is identified as one of four major areas of generaI concern for attracting and keeping women in computer science fields.
Glutaraldehyde-induced changes in the axially projected fine structure of collagen fibrils.

K. Meek,J. A. Chapman

DOI: https://doi.org/10.1016/0022-2836(85)90409-7

IF: 6.151

1985-09-20

Journal of Molecular Biology

Abstract:
Highly accurate classification of chest radiographic reports using a deep learning natural language model pre-trained on 3.8 million text reports

Keno K Bressem,Lisa C Adams,Robert A Gaudin,Daniel Tröltzsch,Bernd Hamm,Marcus R Makowski,Chan-Yong Schüle,Janis L Vahldiek,Stefan M Niehues

DOI: https://doi.org/10.1093/bioinformatics/btaa668

IF: 5.8

2020-07-23

Bioinformatics

Abstract:Abstract Motivation The development of deep, bidirectional transformers such as Bidirectional Encoder Representations from Transformers (BERT) led to an outperformance of several Natural Language Processing (NLP) benchmarks. Especially in radiology, large amounts of free-text data are generated in daily clinical workflow. These report texts could be of particular use for the generation of labels in machine learning, especially for image classification. However, as report texts are mostly unstructured, advanced NLP methods are needed to enable accurate text classification. While neural networks can be used for this purpose, they must first be trained on large amounts of manually labelled data to achieve good results. In contrast, BERT models can be pre-trained on unlabelled data and then only require fine tuning on a small amount of manually labelled data to achieve even better results. Results Using BERT to identify the most important findings in intensive care chest radiograph reports, we achieve areas under the receiver operation characteristics curve of 0.98 for congestion, 0.97 for effusion, 0.97 for consolidation and 0.99 for pneumothorax, surpassing the accuracy of previous approaches with comparatively little annotation effort. Our approach could therefore help to improve information extraction from free-text medical reports. Availability and implementation We make the source code for fine-tuning the BERT-models freely available at https://github.com/fast-raidiology/bert-for-radiology. Supplementary information Supplementary data are available at Bioinformatics online.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
Negation detection in Dutch clinical texts: an evaluation of rule-based and machine learning methods

Bram van Es,Leon C. Reteig,Sander C. Tan,Marijn Schraagen,Myrthe M. Hemker,Sebastiaan R. S. Arends,Miguel A. R. Rios,Saskia Haitjema

DOI: https://doi.org/10.1186/s12859-022-05130-x

IF: 3.307

2023-01-12

BMC Bioinformatics

Abstract:When developing models for clinical information retrieval and decision support systems, the discrete outcomes required for training are often missing. These labels need to be extracted from free text in electronic health records. For this extraction process one of the most important contextual properties in clinical text is negation, which indicates the absence of findings. We aimed to improve large scale extraction of labels by comparing three methods for negation detection in Dutch clinical notes. We used the Erasmus Medical Center Dutch Clinical Corpus to compare a rule-based method based on ContextD, a biLSTM model using MedCAT and (finetuned) RoBERTa-based models. We found that both the biLSTM and RoBERTa models consistently outperform the rule-based model in terms of F1 score, precision and recall. In addition, we systematically categorized the classification errors for each model, which can be used to further improve model performance in particular applications. Combining the three models naively was not beneficial in terms of performance. We conclude that the biLSTM and RoBERTa-based models in particular are highly accurate accurate in detecting clinical negations, but that ultimately all three approaches can be viable depending on the use case at hand.

biochemical research methods,biotechnology & applied microbiology,mathematical & computational biology
A pre-trained language model for emergency department intervention prediction using routine physiological data and clinical narratives

Ting-Yun Huang,Chee-Fah Chong,Heng-Yu Lin,Tzu-Ying Chen,Yung-Chun Chang,Ming-Chin Lin

DOI: https://doi.org/10.1016/j.ijmedinf.2024.105564

Abstract:Introduction: The urgency and complexity of emergency room (ER) settings require precise and swift decision-making processes for patient care. Ensuring the timely execution of critical examinations and interventions is vital for reducing diagnostic errors, but the literature highlights a need for innovative approaches to optimize diagnostic accuracy and patient outcomes. In response, our study endeavors to create predictive models for timely examinations and interventions by leveraging the patient's symptoms and vital signs recorded during triage, and in so doing, augment traditional diagnostic methodologies. Methods: Focusing on four key areas-medication dispensing, vital interventions, laboratory testing, and emergency radiology exams, the study employed Natural Language Processing (NLP) and seven advanced machine learning techniques. The research was centered around the innovative use of BioClinicalBERT, a state-of-the-art NLP framework. Results: BioClinicalBERT emerged as the superior model, outperforming others in predictive accuracy. The integration of physiological data with patient narrative symptoms demonstrated greater effectiveness compared to models based solely on textual data. The robustness of our approach was confirmed by an Area Under the Receiver Operating Characteristic curve (AUROC) score of 0.9. Conclusion: The findings of our study underscore the feasibility of establishing a decision support system for emergency patients, targeting timely interventions and examinations based on a nuanced analysis of symptoms. By using an advanced natural language processing technique, our approach shows promise for enhancing diagnostic accuracy. However, the current model is not yet fully mature for direct implementation into daily clinical practice. Recognizing the imperative nature of precision in the ER environment, future research endeavors must focus on refining and expanding predictive models to include detailed timely examinations and interventions. Although the progress achieved in this study represents an encouraging step towards a more innovative and technology-driven paradigm in emergency care, full clinical integration warrants further exploration and validation.
Deep Learning-Based Natural Language Processing in Radiology: The Impact of Report Complexity, Disease Prevalence, Dataset Size, and Algorithm Type on Model Performance

A. W. Olthof,P. M. A. van Ooijen,L. J. Cornelissen

DOI: https://doi.org/10.1007/s10916-021-01761-4

IF: 4.92

2021-09-04

Journal of Medical Systems

Abstract:Abstract In radiology, natural language processing (NLP) allows the extraction of valuable information from radiology reports. It can be used for various downstream tasks such as quality improvement, epidemiological research, and monitoring guideline adherence. Class imbalance, variation in dataset size, variation in report complexity, and algorithm type all influence NLP performance but have not yet been systematically and interrelatedly evaluated. In this study, we investigate these factors on the performance of four types [a fully connected neural network (Dense), a long short-term memory recurrent neural network (LSTM), a convolutional neural network (CNN), and a Bidirectional Encoder Representations from Transformers (BERT)] of deep learning-based NLP. Two datasets consisting of radiologist-annotated reports of both trauma radiographs (n = 2469) and chest radiographs and computer tomography (CT) studies (n = 2255) were split into training sets (80%) and testing sets (20%). The training data was used as a source to train all four model types in 84 experiments (Fracture-data) and 45 experiments (Chest-data) with variation in size and prevalence. The performance was evaluated on sensitivity, specificity, positive predictive value, negative predictive value, area under the curve, and F score. After the NLP of radiology reports, all four model-architectures demonstrated high performance with metrics up to > 0.90. CNN, LSTM, and Dense were outperformed by the BERT algorithm because of its stable results despite variation in training size and prevalence. Awareness of variation in prevalence is warranted because it impacts sensitivity and specificity in opposite directions.

health care sciences & services,medical informatics
Application of a Domain-specific BERT for Detection of Speech Recognition Errors in Radiology Reports.

Gunvant R. Chaudhari,Tengxiao Liu,Timothy L. Chen,Gabby B. Joseph,Maya Vella,Yoo Jin Lee,Thienkhai H. Vu,Youngho Seo,Andreas M. Rauschecker,Charles E. McCulloch,Jae Ho Sohn

DOI: https://doi.org/10.1148/ryai.210185

2022-01-01

Radiology Artificial Intelligence

Abstract:Purpose: To develop radiology domain-specific bidirectional encoder representations from transformers (BERT) models that can identify speech recognition (SR) errors and suggest corrections in radiology reports. Materials and Methods: A pretrained BERT model, Clinical BioBERT, was further pretrained on a corpus of 114 008 radiology reports between April 2016 and August 2019 that were retrospectively collected from two hospitals. Next, the model was fine-tuned on a training dataset of generated insertion, deletion, and substitution errors, creating Radiology BERT. This model was retrospectively evaluated on an independent dataset of radiology reports with generated errors (n = 18 885) and on unaltered report sentences (n = 2000) and prospectively evaluated on true clinical SR errors (n = 92). Correction Radiology BERT was separately trained to suggest corrections for detected deletion and substitution errors. Area under the receiver operating characteristic curve (AUC) and bootstrapped 95% CIs were calculated for each evaluation dataset. Results: Radiology-specific BERT had AUC values of >.99 (95% CI: .0.99, .0.99), 0.94 (95% CI: 0.93, 0.94), 0.98 (95% CI: 0.98, 0.98), and 0.97 (95% CI: 0.97, 0.97) for detecting insertion, deletion, substitution, and all errors, respectively, on the independently generated test set. Testing on unaltered report impressions revealed a sensitivity of 82% (28 of 34; 95% CI: 70%, 93%) and specificity of 88% (1521 of 1728; 95% CI: 87%, 90%). Testing on prospective SR errors showed an accuracy of 75% (69 of 92; 95% CI: 65%, 83%). Finally, the correct word was the top suggestion for 45.6% (475 of 1041; 95% CI: 42.5%, 49.3%) of errors. Conclusion: Radiology-specific BERT models fine-tuned on generated errors were able to identify SR errors in radiology reports and suggest corrections. (C) RSNA, 2022
Modified Bidirectional Encoder Representations From Transformers Extractive Summarization Model for Hospital Information Systems Based on Character-Level Tokens (AlphaBERT): Development and Performance Evaluation

Yen-Pin Chen,Yi-Ying Chen,Jr-Jiun Lin,Chien-Hua Huang,Feipei Lai

DOI: https://doi.org/10.2196/17787

2020-04-29

Abstract:Background: Doctors must care for many patients simultaneously, and it is time-consuming to find and examine all patients' medical histories. Discharge diagnoses provide hospital staff with sufficient information to enable handling multiple patients; however, the excessive amount of words in the diagnostic sentences poses problems. Deep learning may be an effective solution to overcome this problem, but the use of such a heavy model may also add another obstacle to systems with limited computing resources. Objective: We aimed to build a diagnoses-extractive summarization model for hospital information systems and provide a service that can be operated even with limited computing resources. Methods: We used a Bidirectional Encoder Representations from Transformers (BERT)-based structure with a two-stage training method based on 258,050 discharge diagnoses obtained from the National Taiwan University Hospital Integrated Medical Database, and the highlighted extractive summaries written by experienced doctors were labeled. The model size was reduced using a character-level token, the number of parameters was decreased from 108,523,714 to 963,496, and the model was pretrained using random mask characters in the discharge diagnoses and International Statistical Classification of Diseases and Related Health Problems sets. We then fine-tuned the model using summary labels and cleaned up the prediction results by averaging all probabilities for entire words to prevent character level-induced fragment words. Model performance was evaluated against existing models BERT, BioBERT, and Long Short-Term Memory (LSTM) using the Recall-Oriented Understudy for Gisting Evaluation (ROUGE) L score, and a questionnaire website was built to collect feedback from more doctors for each summary proposal. Results: The area under the receiver operating characteristic curve values of the summary proposals were 0.928, 0.941, 0.899, and 0.947 for BERT, BioBERT, LSTM, and the proposed model (AlphaBERT), respectively. The ROUGE-L scores were 0.697, 0.711, 0.648, and 0.693 for BERT, BioBERT, LSTM, and AlphaBERT, respectively. The mean (SD) critique scores from doctors were 2.232 (0.832), 2.134 (0.877), 2.207 (0.844), 1.927 (0.910), and 2.126 (0.874) for reference-by-doctor labels, BERT, BioBERT, LSTM, and AlphaBERT, respectively. Based on the paired t test, there was a statistically significant difference in LSTM compared to the reference (P<.001), BERT (P=.001), BioBERT (P<.001), and AlphaBERT (P=.002), but not in the other models. Conclusions: Use of character-level tokens in a BERT model can greatly decrease the model size without significantly reducing performance for diagnoses summarization. A well-developed deep-learning model will enhance doctors' abilities to manage patients and promote medical studies by providing the capability to use extensive unstructured free-text notes.
Using Recurrent Neural Networks to Extract High-Quality Information From Lung Cancer Screening Computerized Tomography Reports for Inter-Radiologist Audit and Feedback Quality Improvement

Yucheng Zhang,Benjamin M M Grant,Andrew J Hope,Rayjean J Hung,Matthew T Warkentin,Andrew C L Lam,Reenika Aggawal,Maria Xu,Frances A Shepherd,Ming-Sound Tsao,Wei Xu,Mini Pakkal,Geoffrey Liu,Micheal C McInnis

DOI: https://doi.org/10.1200/CCI.22.00153

Abstract:Purpose: Lung cancer screening programs generate a high volume of low-dose computed tomography (LDCT) reports that contain valuable information, typically in a free-text format. High-performance named-entity recognition (NER) models can extract relevant information from these reports automatically for inter-radiologist quality control. Methods: Using LDCT report data from a longitudinal lung cancer screening program (8,305 reports; 3,124 participants; 2006-2019), we trained a rule-based model and two bidirectional long short-term memory (Bi-LSTM) NER neural network models to detect clinically relevant information from LDCT reports. Model performance was tested using F1 scores and compared with a published open-source radiology NER model (Stanza) in an independent evaluation set of 150 reports. The top performing model was applied to a data set of 6,948 reports for an inter-radiologist quality control assessment. Results: The best performing model, a Bi-LSTM NER recurrent neural network model, had an overall F1 score of 0.950, which outperformed Stanza (F1 score = 0.872) and a rule-based NER model (F1 score = 0.809). Recall (sensitivity) for the best Bi-LSTM model ranged from 0.916 to 0.991 for different entity types; precision (positive predictive value) ranged from 0.892 to 0.997. Test performance remained stable across time periods. There was an average of a 2.86-fold difference in the number of identified entities between the most and the least detailed radiologists. Conclusion: We built an open-source Bi-LSTM NER model that outperformed other open-source or rule-based radiology NER models. This model can efficiently extract clinically relevant information from lung cancer screening computerized tomography reports with high accuracy, enabling efficient audit and feedback to improve quality of patient care.
Use of BERT (Bidirectional Encoder Representations from Transformers)-Based Deep Learning Method for Extracting Evidences in Chinese Radiology Reports: Development of a Computer-Aided Liver Cancer Diagnosis Framework

Honglei Liu,Zhiqiang Zhang,Yan Xu,Ni Wang,Yanqun Huang,Zhenghan Yang,Rui Jiang,Hui Chen

DOI: https://doi.org/10.2196/19689

2021-01-12

Abstract:Background: Liver cancer is a substantial disease burden in China. As one of the primary diagnostic tools for detecting liver cancer, dynamic contrast-enhanced computed tomography provides detailed evidences for diagnosis that are recorded in free-text radiology reports. Objective: The aim of our study was to apply a deep learning model and rule-based natural language processing (NLP) method to identify evidences for liver cancer diagnosis automatically. Methods: We proposed a pretrained, fine-tuned BERT (Bidirectional Encoder Representations from Transformers)-based BiLSTM-CRF (Bidirectional Long Short-Term Memory-Conditional Random Field) model to recognize the phrases of APHE (hyperintense enhancement in the arterial phase) and PDPH (hypointense in the portal and delayed phases). To identify more essential diagnostic evidences, we used the traditional rule-based NLP methods for the extraction of radiological features. APHE, PDPH, and other extracted radiological features were used to design a computer-aided liver cancer diagnosis framework by random forest. Results: The BERT-BiLSTM-CRF predicted the phrases of APHE and PDPH with an F1 score of 98.40% and 90.67%, respectively. The prediction model using combined features had a higher performance (F1 score, 88.55%) than those using APHE and PDPH (84.88%) or other extracted radiological features (83.52%). APHE and PDPH were the top 2 essential features for liver cancer diagnosis. Conclusions: This work was a comprehensive NLP study, wherein we identified evidences for the diagnosis of liver cancer from Chinese radiology reports, considering both clinical knowledge and radiology findings. The BERT-based deep learning method for the extraction of diagnostic evidence achieved state-of-the-art performance. The high performance proves the feasibility of the BERT-BiLSTM-CRF model in information extraction from Chinese radiology reports. The findings of our study suggest that the deep learning-based method for automatically identifying evidences for diagnosis can be extended to other types of Chinese clinical texts.
Identify diabetic retinopathy-related clinical concepts and their attributes using transformer-based natural language processing methods

Zehao Yu,Xi Yang,Gianna L Sweeting,Yinghan Ma,Skylar E Stolte,Ruogu Fang,Yonghui Wu

DOI: https://doi.org/10.1186/s12911-022-01996-2

2022-09-27

Abstract:Background: Diabetic retinopathy (DR) is a leading cause of blindness in American adults. If detected, DR can be treated to prevent further damage causing blindness. There is an increasing interest in developing artificial intelligence (AI) technologies to help detect DR using electronic health records. The lesion-related information documented in fundus image reports is a valuable resource that could help diagnoses of DR in clinical decision support systems. However, most studies for AI-based DR diagnoses are mainly based on medical images; there is limited studies to explore the lesion-related information captured in the free text image reports. Methods: In this study, we examined two state-of-the-art transformer-based natural language processing (NLP) models, including BERT and RoBERTa, compared them with a recurrent neural network implemented using Long short-term memory (LSTM) to extract DR-related concepts from clinical narratives. We identified four different categories of DR-related clinical concepts including lesions, eye parts, laterality, and severity, developed annotation guidelines, annotated a DR-corpus of 536 image reports, and developed transformer-based NLP models for clinical concept extraction and relation extraction. We also examined the relation extraction under two settings including 'gold-standard' setting-where gold-standard concepts were used-and end-to-end setting. Results: For concept extraction, the BERT model pretrained with the MIMIC III dataset achieve the best performance (0.9503 and 0.9645 for strict/lenient evaluation). For relation extraction, BERT model pretrained using general English text achieved the best strict/lenient F1-score of 0.9316. The end-to-end system, BERT_general_e2e, achieved the best strict/lenient F1-score of 0.8578 and 0.8881, respectively. Another end-to-end system based on the RoBERTa architecture, RoBERTa_general_e2e, also achieved the same performance as BERT_general_e2e in strict scores. Conclusions: This study demonstrated the efficiency of transformer-based NLP models for clinical concept extraction and relation extraction. Our results show that it's necessary to pretrain transformer models using clinical text to optimize the performance for clinical concept extraction. Whereas, for relation extraction, transformers pretrained using general English text perform better.
Automatic text classification of actionable radiology reports of tinnitus patients using bidirectional encoder representations from transformer (BERT) and in-domain pre-training (IDPT)

Jia Li,Yucong Lin,Pengfei Zhao,Wenjuan Liu,Linkun Cai,Jing Sun,Lei Zhao,Zhenghan Yang,Hong Song,Han Lv,Zhenchang Wang

DOI: https://doi.org/10.1186/s12911-022-01946-y

2022-07-30

Abstract:Background: Given the increasing number of people suffering from tinnitus, the accurate categorization of patients with actionable reports is attractive in assisting clinical decision making. However, this process requires experienced physicians and significant human labor. Natural language processing (NLP) has shown great potential in big data analytics of medical texts; yet, its application to domain-specific analysis of radiology reports is limited. Objective: The aim of this study is to propose a novel approach in classifying actionable radiology reports of tinnitus patients using bidirectional encoder representations from transformer BERT-based models and evaluate the benefits of in domain pre-training (IDPT) along with a sequence adaptation strategy. Methods: A total of 5864 temporal bone computed tomography(CT) reports are labeled by two experienced radiologists as follows: (1) normal findings without notable lesions; (2) notable lesions but uncorrelated to tinnitus; and (3) at least one lesion considered as potential cause of tinnitus. We then constructed a framework consisting of deep learning (DL) neural networks and self-supervised BERT models. A tinnitus domain-specific corpus is used to pre-train the BERT model to further improve its embedding weights. In addition, we conducted an experiment to evaluate multiple groups of max sequence length settings in BERT to reduce the excessive quantity of calculations. After a comprehensive comparison of all metrics, we determined the most promising approach through the performance comparison of F1-scores and AUC values. Results: In the first experiment, the BERT finetune model achieved a more promising result (AUC-0.868, F1-0.760) compared with that of the Word2Vec-based models(AUC-0.767, F1-0.733) on validation data. In the second experiment, the BERT in-domain pre-training model (AUC-0.948, F1-0.841) performed significantly better than the BERT based model(AUC-0.868, F1-0.760). Additionally, in the variants of BERT fine-tuning models, Mengzi achieved the highest AUC of 0.878 (F1-0.764). Finally, we found that the BERT max-sequence-length of 128 tokens achieved an AUC of 0.866 (F1-0.736), which is almost equal to the BERT max-sequence-length of 512 tokens (AUC-0.868,F1-0.760). Conclusion: In conclusion, we developed a reliable BERT-based framework for tinnitus diagnosis from Chinese radiology reports, along with a sequence adaptation strategy to reduce computational resources while maintaining accuracy. The findings could provide a reference for NLP development in Chinese radiology reports.
Manganese Reduction by Microbes from Oxic Regions of the Lake Vanda (Antarctica) Water Column

B. Bratina,B. Stevenson,W. Green,T. Schmidt

DOI: https://doi.org/10.1128/AEM.64.10.3791-3797.1998

1998-10-01

Applied and Environmental Microbiology

Abstract:ABSTRACT Depth profiles of metals in Lake Vanda, a permanently ice-covered, stratified Antarctic lake, suggest the importance of particulate manganese oxides in the scavenging, transport, and release of metals. Since manganese oxides can be solubilized by manganese-reducing bacteria, microbially mediated manganese reduction was investigated in Lake Vanda. Microbes concentrated from oxic regions of the water column, encompassing a peak of soluble manganese [Mn(II)], reduced synthetic manganese oxides (MnO2) when incubated aerobically. Pure cultures of manganese-reducing bacteria were readily isolated from waters collected near the oxic Mn(II) peak. Based on phylogenetic analysis of the 16S rRNA gene sequence, most of the isolated manganese reducers belong to the genusCarnobacterium. Cultures of a phylogenetically representative strain of Carnobacterium reduced synthetic MnO2 in the presence of sodium azide, as was seen in field assays. Unlike anaerobes that utilize manganese oxides as terminal electron acceptors in respiration, isolates of the genusCarnobacterium reduced Mn(IV) via a diffusible compound under oxic conditions. The release of adsorbed trace metals accompanying the solubilization of manganese oxides may provide populations of Carnobacterium with a source of nutrients in this extremely oligotrophic environment.

Postinduction apnoea in dogs premedicated with acepromazine or dexmedetomidine and anaesthetized with alfaxalone or propofol.

A Large Language Model to Detect Negated Expressions in Radiology Reports

A finite-state automata based negation detection algorithm for Chinese clinical documents

Non-Participation in a Randomized Controlled Trial: The Effect on Clinical and Non-Clinical Variables

The effect of associative strength on priming in the cerebral hemispheres

Evaluation of a BERT Natural Language Processing Model for Automating CT and MRI Triage and Protocol Selection

Implementing engineering education on the WWW: 3 case studies

Deep neural models for automated multi-task diagnostic scan management—quality enhancement, view classification and report generation

Improving mentoring for women in computer science fields (abstract)

Glutaraldehyde-induced changes in the axially projected fine structure of collagen fibrils.

Highly accurate classification of chest radiographic reports using a deep learning natural language model pre-trained on 3.8 million text reports

Negation detection in Dutch clinical texts: an evaluation of rule-based and machine learning methods

A pre-trained language model for emergency department intervention prediction using routine physiological data and clinical narratives

Deep Learning-Based Natural Language Processing in Radiology: The Impact of Report Complexity, Disease Prevalence, Dataset Size, and Algorithm Type on Model Performance

Application of a Domain-specific BERT for Detection of Speech Recognition Errors in Radiology Reports.

Modified Bidirectional Encoder Representations From Transformers Extractive Summarization Model for Hospital Information Systems Based on Character-Level Tokens (AlphaBERT): Development and Performance Evaluation

Using Recurrent Neural Networks to Extract High-Quality Information From Lung Cancer Screening Computerized Tomography Reports for Inter-Radiologist Audit and Feedback Quality Improvement

Use of BERT (Bidirectional Encoder Representations from Transformers)-Based Deep Learning Method for Extracting Evidences in Chinese Radiology Reports: Development of a Computer-Aided Liver Cancer Diagnosis Framework

Identify diabetic retinopathy-related clinical concepts and their attributes using transformer-based natural language processing methods

Automatic text classification of actionable radiology reports of tinnitus patients using bidirectional encoder representations from transformer (BERT) and in-domain pre-training (IDPT)

Manganese Reduction by Microbes from Oxic Regions of the Lake Vanda (Antarctica) Water Column