Abstract:Biomedical and life science literature is an essential way to publish experimental results. With the rapid growth of the number of new publications, the amount of scientific knowledge represented in free text is increasing remarkably. There has been much interest in developing techniques that can extract this knowledge and make it accessible to aid scientists in discovering new relationships between biological entities and answering biological questions. Making use of the word2vec approach, we generated word vector representations based on a corpus consisting of over 16 million PubMed abstracts. We developed a text mining pipeline to produce word2vec embeddings with different properties and performed validation experiments to assess their utility for biomedical analysis. An important pre-processing step consisted in the substitution of synonymous terms by their preferred terms in biomedical databases. Furthermore, we extracted gene-gene networks from two embedding versions and used them as prior knowledge to train Graph-Convolutional Neural Networks (CNNs) on large breast cancer gene expression data and on other cancer datasets. Performances of resulting models were compared to Graph-CNNs trained with protein-protein interaction (PPI) networks or with networks derived using other word embedding algorithms. We also assessed the effect of corpus size on the variability of word representations. Finally, we created a web service with a graphical and a RESTful interface to extract and explore relations between biomedical terms using annotated embeddings. Comparisons to biological databases showed that relations between entities such as known PPIs, signaling pathways and cellular functions, or narrower disease ontology groups correlated with higher cosine similarity. Graph-CNNs trained with word2vec-embedding-derived networks performed sufficiently good for the metastatic event prediction tasks compared to other networks. Such performance was good enough to validate the utility of our generated word embeddings in constructing biological networks. Word representations as produced by text mining algorithms like word2vec, therefore are able to capture biologically meaningful relations between entities. Our generated embeddings are publicly available at https://github.com/genexplain/Word2vec-based-Networks/blob/main/README.md .

Ontology-based Representations of Biological Entities

Onto2Vec: Joint Vector-Based Representation of Biological Entities and Their Ontology-Based Annotations

OPA2Vec: combining formal and informal content of biomedical ontologies to improve similarity-based prediction

OntoSem: an Ontology Semantic Representation Methodology for Biomedical Domain

Machine learning with biomedical ontologies

GO2Vec: Transforming GO Terms and Proteins to Vector Representations Via Graph Embeddings

A Cross‐Domain Ontology Semantic Representation Based on NCBI‐BlueBERT Embedding

Formal axioms in biomedical ontologies improve analysis and interpretation of associated data

A Representation Model For Biological Entities By Fusing Structured Axioms With Unstructured Texts

Ontology Embedding: A Survey of Methods, Applications and Resources

Semantic Similarity and Machine Learning with Ontologies

An Ontology Embedding Approach Based on Multiple Neural Networks.

Global Ontology Entities Embeddings

BiOnt: Deep Learning using Multiple Biomedical Ontologies for Relation Extraction

Towards an Obesity-Cancer Knowledge Base: Biomedical Entity Identification and Relation Detection

The Role of Axiomatically-Rich Ontologies in Transforming Medical Data to Knowledge

Bioentity2vec: Attribute- and behavior-driven representation for predicting multi-type relationships between bioentities.

Text mining-based word representations for biomedical data analysis and protein-protein interaction networks in machine learning tasks

From Ontology to Semantic Similarity: Calculation of Ontology-Based Semantic Similarity

Ontology-based Vector Representations of Biological Entities