UCCB01-125, a dimeric inhibitor of PSD-95, reduces inflammatory pain without disrupting cognitive or motor performance: Comparison with the NMDA receptor antagonist MK-801

J. T. Andreasen,A. Bach,Mikko Gynther,A. Nasser,J. Mogensen,K. Strømgaard,D. Pickering

DOI: https://doi.org/10.1016/j.neuropharm.2012.11.006

IF: 5.273

2013-04-01

Neuropharmacology

Abstract:

What problem does this paper attempt to address?

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

Lejun Gong,Zhifei Zhang,Shiqi Chen

DOI: https://doi.org/10.1155/2020/8829219

2020-01-01

Journal of Healthcare Engineering

Abstract:Background. Clinical named entity recognition is the basic task of mining electronic medical records text, which are with some challenges containing the language features of Chinese electronic medical records text with many compound entities, serious missing sentence components, and unclear entity boundary. Moreover, the corpus of Chinese electronic medical records is difficult to obtain. Methods. Aiming at these characteristics of Chinese electronic medical records, this study proposed a Chinese clinical entity recognition model based on deep learning pretraining. The model used word embedding from domain corpus and fine-tuning of entity recognition model pretrained by relevant corpus. Then BiLSTM and Transformer are, respectively, used as feature extractors to identify four types of clinical entities including diseases, symptoms, drugs, and operations from the text of Chinese electronic medical records. Results. 75.06% Macro-P, 76.40% Macro-R, and 75.72% Macro-F1 aiming at test dataset could be achieved. These experiments show that the Chinese clinical entity recognition model based on deep learning pretraining can effectively improve the recognition effect. Conclusions. These experiments show that the proposed Chinese clinical entity recognition model based on deep learning pretraining can effectively improve the recognition performance.
New perspectives in diagnosis and management of thrombophlebitis of the superficial dorsal vein of the penis.

S. Khan,N. Smith,K. Hu

DOI: https://doi.org/10.1111/J.1524-4725.1982.TB01095.X

1982-12-01

The Journal of Dermatologic Surgery and Oncology

Abstract:Thrombophlebitis of the superficial dorsal vein of the penis, “Mondor's disease” of the penis, is a rare peripheral venous disease. The causes are interesting and multifactorial, including sexual trauma, tourniquet effect produced by occlusive devices applied to the penis, venipuncture, and local infection. We found that doppler examination of the superficial dorsal vein of the penis, using a “percussion maneuver,” is very useful for detecting patency and following the course of recannalization. In the acute stage, we found local paravenous infiltration of 0.5% Marcain to be effective in prompt relief of symptoms.
A comprehensive study of named entity recognition in Chinese clinical text

Jianbo Lei,Buzhou Tang,Xueqin Lu,Kaihua Gao,Min Jiang,Hua Xu,J. Lei,B. Tang,X. Lu,K. Gao,M. Jiang,H. Xu

DOI: https://doi.org/10.1136/amiajnl-2013-002381

2014-09-01

Journal of the American Medical Informatics Association

Abstract:OBJECTIVE: Named entity recognition (NER) is one of the fundamental tasks in natural language processing. In the medical domain, there have been a number of studies on NER in English clinical notes; however, very limited NER research has been carried out on clinical notes written in Chinese. The goal of this study was to systematically investigate features and machine learning algorithms for NER in Chinese clinical text.MATERIALS AND METHODS: We randomly selected 400 admission notes and 400 discharge summaries from Peking Union Medical College Hospital in China. For each note, four types of entity-clinical problems, procedures, laboratory test, and medications-were annotated according to a predefined guideline. Two-thirds of the 400 notes were used to train the NER systems and one-third for testing. We investigated the effects of different types of feature including bag-of-characters, word segmentation, part-of-speech, and section information, and different machine learning algorithms including conditional random fields (CRF), support vector machines (SVM), maximum entropy (ME), and structural SVM (SSVM) on the Chinese clinical NER task. All classifiers were trained on the training dataset and evaluated on the test set, and micro-averaged precision, recall, and F-measure were reported.RESULTS: Our evaluation on the independent test set showed that most types of feature were beneficial to Chinese NER systems, although the improvements were limited. The system achieved the highest performance by combining word segmentation and section information, indicating that these two types of feature complement each other. When the same types of optimized feature were used, CRF and SSVM outperformed SVM and ME. More specifically, SSVM achieved the highest performance of the four algorithms, with F-measures of 93.51% and 90.01% for admission notes and discharge summaries, respectively.

information science & library science,computer science, information systems, interdisciplinary applications,health care sciences & services,medical informatics
PhenoID, a language model normalizer of physical examinations from genetics clinical notes

Davy Weissenbacher,Siddharth Rawal,Xinwei Zhao,Jessica R C Priestley,Katherine M Szigety,Sarah F Schmidt,Mary J Higgins,Arjun Magge,Karen O'Connor,Graciela Gonzalez-Hernandez,Ian M Campbell

DOI: https://doi.org/10.1101/2023.10.16.23296894

2024-01-03

MedRxiv

Abstract:Background: Phenotypes identified during dysmorphology physical examinations are critical to genetic diagnosis and nearly universally documented as free-text in the electronic health record (EHR). Variation in how phenotypes are recorded in free-text makes large-scale computational analysis extremely challenging. Existing natural language processing (NLP) approaches to address phenotype extraction are trained largely on the biomedical literature or on case vignettes rather than actual EHR data. Methods: We implemented a tailored system at the Children's Hospital of Philadelpia that allows clinicians to document dysmorphology physical exam findings. From the underlying data, we manually annotated a corpus of 3136 organ system observations using the Human Phenotype Ontology (HPO). We provide this corpus publicly. We trained a transformer based NLP system to identify HPO terms from exam observations. The pipeline includes an extractor, which identifies tokens in the sentence expected to contain an HPO term, and a normalizer, which uses those tokens together with the original observation to determine the specific term mentioned. Findings: We find that our labeler and normalizer NLP pipeline, which we call PhenoID, achieves state-of-the-art performance for the dysmorphology physical exam phenotype extraction task. PhenoID's performance on the test set was 0.717, compared to the nearest baseline system (Pheno-Tagger) performance of 0.633. An analysis of our system's normalization errors shows possible imperfections in the HPO terminology itself but also reveals a lack of semantic understanding by our transformer models. Interpretation: Transformers-based NLP models are a promising approach to genetic phenotype extraction and, with recent development of larger pre-trained causal language models, may improve semantic understanding in the future. We believe our results also have direct applicability to more general extraction of medical signs and symptoms. Funding: US National Institutes of Health.
PhenoBERT: A Combined Deep Learning Method for Automated Recognition of Human Phenotype Ontology.

Yuhao Feng,Lei Qi,Weidong Tian

DOI: https://doi.org/10.1109/tcbb.2022.3170301

2022-01-01

IEEE/ACM Transactions on Computational Biology and Bioinformatics

Abstract:Automated recognition of Human Phenotype Ontology (HPO) terms from clinical texts is of significant interest to the field of clinical data mining. In this study, we develop a combined deep learning method named PhenoBERT for this purpose. PhenoBERT uses BERT, currently the state-of-the-art NLP model, as its core model for evaluating whether a clinically relevant text segment (CTS) could be represented by an HPO term. However, to avoid unnecessary comparison of a CTS with each of ∼14,000 HPO terms using BERT, we introduce a two-levels CNN module consisting of a series of CNN models organized at two levels in PhenoBERT. For a given CTS, the CNN module produces only a short list of candidate HPO terms for BERT to evaluate, significantly improving the computational efficiency. In addition, BERT is able to assign an ancestor HPO term to a CTS when recognition of the direct HPO term is not successful, mimicking the process of HPO term assignment by human. In two benchmarks, PhenoBERT outperforms four traditional dictionary-based methods and two recently developed deep learning-based methods in two benchmark tests, and its advantage is more obvious when the recognition task is more challenging. As such, PhenoBERT is of great use for assisting in the mining of clinical text data.
A Cross-institutional Evaluation on Breast Cancer Phenotyping NLP Algorithms on Electronic Health Records

Sicheng Zhou,Nan Wang,Liwei Wang,Ju Sun,Anne Blaes,Hongfang Liu,Rui Zhang

DOI: https://doi.org/10.1016/j.csbj.2023.08.018

IF: 6.155

2023-08-24

Computational and Structural Biotechnology Journal

Abstract:Highlights • Evaluated the impact of corpus heterogeneity on the generalizability of series NLP models, including CRF, BiLSTM-CRF and BERT based models. • Novel analysis of robustness of the machine learning models using permutation dataset. • Compared two strategies for transferring machine learning models between clinical institutes, i.e., i) direct transfer vs ii) continuous fine-tuning. Objective Transformer-based language models are prevailing in the clinical domain due to their excellent performance on clinical NLP tasks. The generalizability of those models is usually ignored during the model development process. This study evaluated the generalizability of CancerBERT, a Transformer-based clinical NLP model, along with classic machine learning models, i.e., conditional random field (CRF), bi-directional long short-term memory CRF (BiLSTM-CRF), across different clinical institutes through a breast cancer phenotype extraction task. Materials and Methods Two clinical corpora of breast cancer patients were collected from the electronic health records from the University of Minnesota and Mayo Clinic, and annotated following the same guideline. We developed three types of NLP models (i.e., CRF, BiLSTM-CRF and CancerBERT) to extract cancer phenotypes from clinical texts. We evaluated the generalizability of models on different test sets with different learning strategies (model transfer vs locally trained). The entity coverage score was assessed with their association with the model performances. Results We manually annotated 200 and 161 clinical documents at UMN and MC. The corpora of the two institutes were found to have higher similarity between the target entities than the overall corpora. The CancerBERT models obtained the best performances among the independent test sets from two clinical institutes and the permutation test set. The CancerBERT model developed in one institute and further fine-tuned in another institute achieved reasonable performance compared to the model developed on local data (micro-F1: 0.925 vs 0.932). Conclusions The results indicate the CancerBERT model has superior learning ability and generalizability among the three types of clinical NLP models for our named entity recognition task. It has the advantage to recognize complex entities, e.g., entities with different labels. Graphical abstract Download : Download high-res image (110KB) Download : Download full-size image

biochemistry & molecular biology
A Novel Approach Towards Medical Entity Recognition in Chinese Clinical Text.

Jun Liang,Xuemei Xian,Xiaojun He,Meifang Xu,Sheng Dai,Jun'yi Xin,Jie Xu,Jian Yu,Jianbo Lei

DOI: https://doi.org/10.1155/2017/4898963

2017-01-01

Journal of Healthcare Engineering

Abstract:Medical entity recognition, a basic task in the language processing of clinical data, has been extensively studied in analyzing admission notes in alphabetic languages such as English. However, much less work has been done on nonstructural texts that are written in Chinese, or in the setting of differentiation of Chinese drug names between traditional Chinese medicine and Western medicine. Here, we propose a novel cascade-type Chinese medication entity recognition approach that aims at integrating the sentence category classifier from a support vector machine and the conditional random field-based medication entity recognition. We hypothesized that this approach could avoid the side effects of abundant negative samples and improve the performance of the named entity recognition from admission notes written in Chinese. Therefore, we applied this approach to a test set of 324 Chinese-written admission notes with manual annotation by medical experts. Our data demonstrated that this approach had a score of 94.2% in precision, 92.8% in recall, and 93.5% in F-measure for the recognition of traditional Chinese medicine drug names and 91.2% in precision, 92.6% in recall, and 91.7% F-measure for the recognition of Western medicine drug names. The differences in F-measure were significant compared with those in the baseline systems.
Natural products containing a nitrogen-nitrogen bond.

Lachlan M. Blair,J. Sperry

DOI: https://doi.org/10.1021/np400124n

IF: 5.1

2013-04-11

Journal of Natural Products

Abstract:As of early 2013, over 200 natural products are known to contain a nitrogen-nitrogen (N-N) bond. This report categorizes these compounds by structural class and details their isolation and biological activity.
An NLP System for COVID/PASC: A Case Demonstration of the OHNLP Toolkit from the National COVID Cohort Collaborative and the RECOVER Programs (Preprint)

Andrew Wen,Liwei Wang,Huan He,Sunyang Fu,Sijia Liu,David A Hanauer,Daniel R Harris,Ramakanth Kavuluru,Rui Zhang,Karthik Natarajan,Nishanth P Pavinkurve,Janos Hajagos,Sritha Rajupet,Veena Lingam,Mary Saltz,Corey Elowsky,Richard A Moffitt,Farrukh M Koraishy,Matvey B Palchuk,Jordan Donovan,Lora Lingrey,Garo Stone-DerHargopian,Robert T Miller,Andrew E Williams,Peter J Leese,Paul I Kovach,Emily R Pfaff,Mikhail Zemmel,Robert D Pates,Nick Guthe,Melissa A Haendel,Christopher G Chute,Hongfang Liu

DOI: https://doi.org/10.2196/49997

IF: 3.2

2023-01-01

JMIR Medical Informatics

Abstract:BACKGROUND A wealth of clinically relevant information is only obtainable within unstructured clinical narratives, leading to great interest in clinical natural language processing (NLP). While a multitude of approaches to NLP exist, current algorithm development approaches have limitations that can slow the development process. These limitations are exacerbated when the task is novel or evolving, as is the case currently for NLP extraction of signs and symptoms of COVID-19 and post-acute sequelae of SARS CoV-2 Infection (PASC). OBJECTIVE To highlight current limitations of existing NLP algorithm development approaches that are exacerbated by NLP tasks surrounding novel and evolving clinical concepts, and to illustrate our approach to addressing these issues through the use case of developing an NLP system for signs and symptoms of COVID-19 and PASC. METHODS Two pre-existing studies on PASC were used as a baseline to determine a set of concepts that should be extracted by NLP. This concept list was then used in conjunction with the Unified Medical Language System (UMLS) to autonomously generate an expanded lexicon to weakly annotate a training set, that was then reviewed by a human expert to generate a fine-tuned NLP algorithm. The annotations from a fully human-annotated test set were then compared with NLP results from the fine-tuned algorithm. The NLP algorithm was then deployed to 10 additional sites also running our NLP infrastructure. Of these 10 sites, 5 were used to conduct a federated evaluation of the NLP algorithm. RESULTS An NLP algorithm consisting of 12,234 unique normalized text strings corresponding to 2,366 unique concepts was developed to extract COVID-19/PASC signs and symptoms. An unweighted mean dictionary coverage of 77.8% was found for the five sites. CONCLUSIONS The evolutionary and time-critical nature of the PASC NLP task significantly complicates existing approaches to NLP algorithm development. In this work, we present a hybrid approach utilizing the Open Health Natural Language Processing (OHNLP) toolkit aimed at addressing these needs with a dictionary-based weak labeling step minimizing the need for additional expert annotation while still preserving the fine-tuning capabilities of expert involvement.
An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records

Luqi Li,Jie Zhao,Li Hou,Yunkai Zhai,Jinming Shi,Fangfang Cui

DOI: https://doi.org/10.1186/s12911-019-0933-6

IF: 3.298

2019-12-01

BMC Medical Informatics and Decision Making

Abstract:Abstract Background Clinical named entity recognition (CNER) is important for medical information mining and establishment of high-quality knowledge map. Due to the different text features from natural language and a large number of professional and uncommon clinical terms in Chinese electronic medical records (EMRs), there are still many difficulties in clinical named entity recognition of Chinese EMRs. It is of great importance to eliminate semantic interference and improve the ability of autonomous learning of internal features of the model under the small training corpus. Methods From the perspective of deep learning, we integrated the attention mechanism into neural network, and proposed an improved clinical named entity recognition method for Chinese electronic medical records called BiLSTM-Att-CRF, which could capture more useful information of the context and avoid the problem of missing information caused by long-distance factors. In addition, medical dictionaries and part-of-speech (POS) features were also introduced to improve the performance of the model. Results Based on China Conference on Knowledge Graph and Semantic Computing (CCKS) 2017 and 2018 Chinese EMRs corpus, our BiLSTM-Att-CRF model finally achieved better performance than other widely-used models without additional features(F1-measure of 85.4% in CCKS 2018, F1-measure of 90.29% in CCKS 2017), and achieved the best performance with POS and dictionary features (F1-measure of 86.11% in CCKS 2018, F1-measure of 90.48% in CCKS 2017). In particular, the BiLSTM-Att-CRF model had significant effect on the improvement of Recall. Conclusions Our work preliminarily confirmed the validity of attention mechanism in discovering key information and mining text features, which might provide useful ideas for future research in clinical named entity recognition of Chinese electronic medical records. In the future, we will explore the deeper application of attention mechanism in neural network.

medical informatics
Enhancing Phenotype Recognition in Clinical Notes Using Large Language Models: PhenoBCBERT and PhenoGPT

Jingye Yang,Cong Liu,Wendy Deng,Da Wu,Chunhua Weng,Yunyun Zhou,Kai Wang

2023-11-09

Abstract:We hypothesize that large language models (LLMs) based on the transformer architecture can enable automated detection of clinical phenotype terms, including terms not documented in the HPO. In this study, we developed two types of models: PhenoBCBERT, a BERT-based model, utilizing Bio+Clinical BERT as its pre-trained model, and PhenoGPT, a GPT-based model that can be initialized from diverse GPT models, including open-source versions such as GPT-J, Falcon, and LLaMA, as well as closed-source versions such as GPT-3 and GPT-3.5. We compared our methods with PhenoTagger, a recently developed HPO recognition tool that combines rule-based and deep learning methods. We found that our methods can extract more phenotype concepts, including novel ones not characterized by HPO. We also performed case studies on biomedical literature to illustrate how new phenotype information can be recognized and extracted. We compared current BERT-based versus GPT-based models for phenotype tagging, in multiple aspects including model architecture, memory usage, speed, accuracy, and privacy protection. We also discussed the addition of a negation step and an HPO normalization layer to the transformer models for improved HPO term tagging. In conclusion, PhenoBCBERT and PhenoGPT enable the automated discovery of phenotype terms from clinical notes and biomedical literature, facilitating automated downstream tasks to derive new biological insights on human diseases.

Quantitative Methods,Artificial Intelligence
[EFFECTS OF GLUTEN ON INTESTINAL ABSORPTION AND PERMEABILITY DURING REMISSION OF CELIAC DISEASE].

P. Careddu,G. Chiumello,A. Vaccari,M. Bardare,A. Zilocchi

1963-11-15

Abstract:
COVID-19 SignSym: a fast adaptation of a general clinical NLP tool to identify and normalize COVID-19 signs and symptoms to OMOP common data model

Jingqi Wang,Noor Abu-el-rub,Josh Gray,Huy Anh Pham,Yujia Zhou,Frank Manion,Mei Liu,Xing Song,Hua Xu,Masoud Rouhizadeh,Yaoyun Zhang

DOI: https://doi.org/10.1093/jamia/ocab015

2021-04-08

Abstract:The COVID-19 pandemic swept across the world rapidly, infecting millions of people. An efficient tool that can accurately recognize important clinical concepts of COVID-19 from free text in electronic health records (EHRs) will be valuable to accelerate COVID-19 clinical research. To this end, this study aims at adapting the existing CLAMP natural language processing tool to quickly build COVID-19 SignSym, which can extract COVID-19 signs/symptoms and their 8 attributes (body location, severity, temporal expression, subject, condition, uncertainty, negation, and course) from clinical text. The extracted information is also mapped to standard concepts in the Observational Medical Outcomes Partnership common data model. A hybrid approach of combining deep learning-based models, curated lexicons, and pattern-based rules was applied to quickly build the COVID-19 SignSym from CLAMP, with optimized performance. Our extensive evaluation using 3 external sites with clinical notes of COVID-19 patients, as well as the online medical dialogues of COVID-19, shows COVID-19 Sign-Sym can achieve high performance across data sources. The workflow used for this study can be generalized to other use cases, where existing clinical natural language processing tools need to be customized for specific information needs within a short time. COVID-19 SignSym is freely accessible to the research community as a downloadable package (<a class="link-external link-https" href="https://clamp.uth.edu/covid/nlp.php" rel="external noopener nofollow">this https URL</a>) and has been used by 16 healthcare organizations to support clinical research of COVID-19.

Computation and Language
Medical Named Entity Recognition Fusing Part-of-Speech and Stroke Features

Fen Yi,Hong Liu,You Wang,Sheng Wu,Cheng Sun,Peng Feng,Jin Zhang

DOI: https://doi.org/10.3390/app13158913

2023-01-01

Applied Sciences

Abstract:It is highly significant from a research standpoint and a valuable practice to identify diseases, symptoms, drugs, examinations, and other medical entities in medical text data to support knowledge maps, question and answer systems, and other downstream tasks that can provide the public with knowledgeable answers. However, when contrasted with other languages like English, Chinese words lack a distinct dividing line, and medical entities have problems such as long length and multiple entity types nesting. Therefore, to address these issues, this study suggests a medical named entity recognition (NER) approach that combines part-of-speech and stroke features. First, the text is fed into the BERT pre-training model to get the semantic representation of the text, while the part-of-speech feature vector is obtained using the part-of-speech dictionary, and the stroke feature of the text is extracted through a convolution neural network (CNN). The word vector is then joined with the part-of-speech and stroke feature vectors, respectively, and input into the BiLSTM and CRF layer for training. Additionally, to balance the disparity in data volume across several types of entities, the class-weighted loss function is included in the loss function. According to the experimental findings, our model's F1 score on the CCKS2019 dataset reaches 78.65%, and the recognition performance exceeds many existing algorithms.
Extraction of Traditional Chinese Medicine Entity: Design of a Novel Span-Level Named Entity Recognition Method With Distant Supervision

Qi Jia,Dezheng Zhang,Haifeng Xu,Yonghong Xie

DOI: https://doi.org/10.2196/28219

2021-06-14

Abstract:Background: Traditional Chinese medicine (TCM) clinical records contain the symptoms of patients, diagnoses, and subsequent treatment of doctors. These records are important resources for research and analysis of TCM diagnosis knowledge. However, most of TCM clinical records are unstructured text. Therefore, a method to automatically extract medical entities from TCM clinical records is indispensable. Objective: Training a medical entity extracting model needs a large number of annotated corpus. The cost of annotated corpus is very high and there is a lack of gold-standard data sets for supervised learning methods. Therefore, we utilized distantly supervised named entity recognition (NER) to respond to the challenge. Methods: We propose a span-level distantly supervised NER approach to extract TCM medical entity. It utilizes the pretrained language model and a simple multilayer neural network as classifier to detect and classify entity. We also designed a negative sampling strategy for the span-level model. The strategy randomly selects negative samples in every epoch and filters the possible false-negative samples periodically. It reduces the bad influence from the false-negative samples. Results: We compare our methods with other baseline methods to illustrate the effectiveness of our method on a gold-standard data set. The F1 score of our method is 77.34 and it remarkably outperforms the other baselines. Conclusions: We developed a distantly supervised NER approach to extract medical entity from TCM clinical records. We estimated our approach on a TCM clinical record data set. Our experimental results indicate that the proposed approach achieves a better performance than other baselines.
Exploiting the concept level feature for enhanced name entity recognition in Chinese EMRs

Qing Zhao,Dan Wang,Jianqiang Li,Faheem Akhtar

DOI: https://doi.org/10.1007/s11227-019-02917-3

IF: 3.3

2019-06-10

The Journal of Supercomputing

Abstract:The accumulation and explosive growth of the electronic medical records (EMRs) make the name entity recognition (NER) technologies become critical for the meaningful use of EMR data and then the practice of evidence-based medicine. The dominate NER approaches use the distributed representation of the words and characters to build deep learning-based NER models. However, for the task of biomedical named entity recognition, there are a large amount of complicated medical terminologies that are composed of multiple words. Splitting these terminologies to learn the word and character embeddings might cause semantic ambiguities. In this paper, we treat each medical terminology as a concept and propose a concept-enhanced named entity recognition model (CNER), where the features from three different granularities (i.e., concept, word, and character) are combined together for bio-NER. The extensive experiments are conducted on two real-world corpora: fully labeled corpus and partially labeled corpus. CNER achieves the highest F1 score (fully labeled corpus: precision = 88.23, recall = 88.29, and F1 = 88.26; partially labeled corpus: precision = 87.03, recall = 88.19, and F1 = 87.61) by outperforming the baseline CW-BLSTM-CRF approach for 0.58% and 1.15% respectively, which demonstrates the effectiveness of the proposed approach.
Transient Protection Devices

Chin-Lin Chen

DOI: https://doi.org/10.1109/ISEMC.1975.7567819

1975-10-01

Abstract:
Chinese Clinical Named Entity Recognition with ALBERT and MHA Mechanism

Dongmei Li,Jiao Long,Jintao Qu,Xiaoping Zhang

DOI: https://doi.org/10.1155/2022/2056039

2022-05-23

Abstract:Traditional clinical named entity recognition methods fail to balance the effectiveness of feature extraction of unstructured text and the complexity of neural network models. We propose a model based on ALBERT and a multihead attention (MHA) mechanism to solve this problem. Structurally, the model first obtains character-level word embeddings through the ALBERT pretraining language model, then inputs the word embeddings into the iterated dilated convolutional neural network model to quickly extract global semantic information, and decodes the predicted labels through conditional random fields to obtain the optimal label sequence. Also, we apply the MHA mechanism to capture intercharacter dependencies from multiple aspects. Furthermore, we use the RAdam optimizer to boost the convergence speed and improve the generalization ability of our model. Experimental results show that our model achieves an F1 score of 85.63% on the CCKS-2019 dataset-an increase of 4.36% compared to the baseline model.
Advantageous Syntheses of Stilbenes via Benzotriazole-Stabilized Anions.

A. Katritzky,D. Tymoshenko,S. Belyakov

DOI: https://doi.org/10.1002/CHIN.199933114

1999-04-30

Abstract:
Self-Supervised Detection of Contextual Synonyms in a Multi-Class Setting: Phenotype Annotation Use Case

Jingqing Zhang,Luis Bolanos,Tong Li,Ashwani Tanwar,Guilherme Freire,Xian Yang,Julia Ive,Vibhor Gupta,Yike Guo

DOI: https://doi.org/10.48550/arXiv.2109.01935

2021-09-05

Abstract:Contextualised word embeddings is a powerful tool to detect contextual synonyms. However, most of the current state-of-the-art (SOTA) deep learning concept extraction methods remain supervised and underexploit the potential of the context. In this paper, we propose a self-supervised pre-training approach which is able to detect contextual synonyms of concepts being training on the data created by shallow matching. We apply our methodology in the sparse multi-class setting (over 15,000 concepts) to extract phenotype information from electronic health records. We further investigate data augmentation techniques to address the problem of the class sparsity. Our approach achieves a new SOTA for the unsupervised phenotype concept annotation on clinical text on F1 and Recall outperforming the previous SOTA with a gain of up to 4.5 and 4.0 absolute points, respectively. After fine-tuning with as little as 20\% of the labelled data, we also outperform BioBERT and ClinicalBERT. The extrinsic evaluation on three ICU benchmarks also shows the benefit of using the phenotypes annotated by our model as features.

Computation and Language

UCCB01-125, a dimeric inhibitor of PSD-95, reduces inflammatory pain without disrupting cognitive or motor performance: Comparison with the NMDA receptor antagonist MK-801

Clinical Named Entity Recognition from Chinese Electronic Medical Records Based on Deep Learning Pretraining

New perspectives in diagnosis and management of thrombophlebitis of the superficial dorsal vein of the penis.

A comprehensive study of named entity recognition in Chinese clinical text

PhenoID, a language model normalizer of physical examinations from genetics clinical notes

PhenoBERT: A Combined Deep Learning Method for Automated Recognition of Human Phenotype Ontology.

A Cross-institutional Evaluation on Breast Cancer Phenotyping NLP Algorithms on Electronic Health Records

A Novel Approach Towards Medical Entity Recognition in Chinese Clinical Text.

Natural products containing a nitrogen-nitrogen bond.

An NLP System for COVID/PASC: A Case Demonstration of the OHNLP Toolkit from the National COVID Cohort Collaborative and the RECOVER Programs (Preprint)

An attention-based deep learning model for clinical named entity recognition of Chinese electronic medical records

Enhancing Phenotype Recognition in Clinical Notes Using Large Language Models: PhenoBCBERT and PhenoGPT

[EFFECTS OF GLUTEN ON INTESTINAL ABSORPTION AND PERMEABILITY DURING REMISSION OF CELIAC DISEASE].

COVID-19 SignSym: a fast adaptation of a general clinical NLP tool to identify and normalize COVID-19 signs and symptoms to OMOP common data model

Medical Named Entity Recognition Fusing Part-of-Speech and Stroke Features

Extraction of Traditional Chinese Medicine Entity: Design of a Novel Span-Level Named Entity Recognition Method With Distant Supervision

Exploiting the concept level feature for enhanced name entity recognition in Chinese EMRs

Transient Protection Devices

Chinese Clinical Named Entity Recognition with ALBERT and MHA Mechanism

Advantageous Syntheses of Stilbenes via Benzotriazole-Stabilized Anions.

Self-Supervised Detection of Contextual Synonyms in a Multi-Class Setting: Phenotype Annotation Use Case