Abstract:A massive number of biological entities, such as genes and mutations, are mentioned in the biomedical literature. The capturing of the semantic relatedness of biological entities is vital to many biological applications, such as protein-protein interaction prediction and literature-based discovery. Concept embeddings-which involve the learning of vector representations of concepts using machine learning models-have been employed to capture the semantics of concepts. To develop concept embeddings, named-entity recognition (NER) tools are first used to identify and normalize concepts from the literature, and then different machine learning models are used to train the embeddings. Despite multiple attempts, existing biomedical concept embeddings generally suffer from suboptimal NER tools, small-scale evaluation, and limited availability. In response, we employed high-performance machine learning-based NER tools for concept recognition and trained our concept embeddings, BioConceptVec, via four different machine learning models on ~30 million PubMed abstracts. BioConceptVec covers over 400,000 biomedical concepts mentioned in the literature and is of the largest among the publicly available biomedical concept embeddings to date. To evaluate the validity and utility of BioConceptVec, we respectively performed two intrinsic evaluations (identifying related concepts based on drug-gene and gene-gene interactions) and two extrinsic evaluations (protein-protein interaction prediction and drug-drug interaction extraction), collectively using over 25 million instances from nine independent datasets (17 million instances from six intrinsic evaluation tasks and 8 million instances from three extrinsic evaluation tasks), which is, by far, the most comprehensive to our best knowledge. The intrinsic evaluation results demonstrate that BioConceptVec consistently has, by a large margin, better performance than existing concept embeddings in identifying similar and related concepts. More importantly, the extrinsic evaluation results demonstrate that using BioConceptVec with advanced deep learning models can significantly improve performance in downstream bioinformatics studies and biomedical text-mining applications. Our BioConceptVec embeddings and benchmarking datasets are publicly available at https://github.com/ncbi-nlp/BioConceptVec.

Concept2vec: Metrics for Evaluating Quality of Embeddings for Ontological Concepts

Towards Robust Metrics for Concept Representation Evaluation

Learning Concept Embeddings for Efficient Bag-of-Concepts Densification

BioConceptVec: Creating and evaluating literature-based biomedical concept embeddings on a large scale

A Fistful of Vectors: A Tool for Intrinsic Evaluation of Word Embeddings

Knowledge Graph Embeddings for Dealing with Concept Drift in Machine Learning

Beyond Accuracy: Measuring Representation Capacity of Embeddings to Preserve Structural and Contextual Information

Measuring similarity between embedding spaces using induced neighborhood graphs

Concept-Based Embeddings for Natural Language Processing

Interpreting Embedding Spaces by Conceptualization

Exploring Wasserstein Distance across Concept Embeddings for Ontology Matching

Snomed2Vec: Random Walk and Poincaré Embeddings of a Clinical Knowledge Base for Healthcare Analytics

Knowledge graph embedding with concepts

Estimating Text Similarity based on Semantic Concept Embeddings

Interpretable Measures of Conceptual Similarity by Complexity-Constrained Descriptive Auto-Encoding

EmbeddingVis: A Visual Analytics Approach to Comparative Network Embedding Inspection

Making Fast Graph-based Algorithms with Graph Metric Embeddings

Ontology Embedding: A Survey of Methods, Applications and Resources

DocCit2Vec: Citation Recommendation Via Embedding of Content and Structural Contexts

CMG2Vec: A composite meta-graph based heterogeneous information network embedding approach

Machine Learning-Based Design Concept Evaluation