Abstract:Assigning labels from a hierarchical vocabulary is a well known special case of multi-label classification, often modeled to maximize micro F1-score. However, building accurate binary classifiers for poorly performing labels in the hierarchy can improve both micro and macro F1-scores. In this paper, we propose and evaluate classification strategies involving descendant node instances to build better binary classifiers for non-leaf labels with the use-case of assigning Medical Subject Headings (MeSH) to biomedical articles. Librarians at the National Library of Medicine tag each biomedical article to be indexed by their PubMed information system with terms from the MeSH terminology, a biomedical conceptual hierarchy with over 27,000 terms. Human indexers look at each article's full text to assign a set of most suitable MeSH terms for indexing it. Several recent automated attempts focused on using the article title and abstract text to identify MeSH terms for the corresponding article. Despite these attempts, it is observed that assigning MeSH terms corresponding to certain non-leaf nodes of the MeSH hierarchy is particularly challenging. Non-leaf nodes are very important as they constitute one third of the total number of MeSH terms. Here, we demonstrate the effectiveness of exploiting training examples of descendant terms of non-leaf nodes in improving the performance of conventional classifiers for the corresponding non-leaf MeSH terms. Specifically, we focus on reducing the false positives (FPs) caused due to descendant instances in traditional classifiers. Our methods are able to achieve a relative improvement of 7.5% in macro-F1 score while also increasing the micro-F1 score by 1.6% for a set of 500 non-leaf terms in the MeSH hierarchy. These results strongly indicate the critical role of incorporating hierarchical information in MeSH term prediction. To our knowledge, our effort is the first to demonstrate the role of hierarchical information in improving binary classifiers for non-leaf MeSH terms.

MeSHLabeler and DeepMeSH: Recent Progress in Large-Scale MeSH Indexing.

DeepMeSH: Deep Semantic Representation for Improving Large-Scale MeSH Indexing.

FullMeSH: Improving Large-Scale MeSH Indexing with Full Text.

MeSHLabeler: Improving the Accuracy of Large-Scale MeSH Indexing by Integrating Diverse Evidence.

BERTMeSH: deep contextual representation learning for large-scale high-performance MeSH indexing with full text

MeSH Now: automatic MeSH indexing at PubMed scale via learning to rank

MeSHup: A Corpus for Full Text Biomedical Document Indexing

MeSHProbeNet: a Self-Attentive Probe Net for MeSH Indexing

Recommending MeSH terms for annotating biomedical articles

MeSHSim: an R/Bioconductor Package for Measuring Semantic Similarity over MeSH Headings and MEDLINE Documents.

Automatic Annotation of PubMed Articles with MeSH Qualifiers

The Fudan Participation in the 2015 BioASQ Challenge: Large-scale Biomedical Semantic Indexing and Question Answering.

Biomedical Semantic Indexing by Deep Neural Network with Multi-Task Learning

Pymeshsim: an Integrative Python Package for Biomedical Named Entity Recognition, Normalization, and Comparison of MeSH Terms

MeSHelper: Predicting the evolution of Medical Subject Headings based on knowledge graph dynamics

Automatic Assignment of Non-Leaf MeSH Terms to Biomedical Articles

Automated MeSH Indexing of Biomedical Literature Using Contextualized Word Representations

Prioritization, clustering and functional annotation of MicroRNAs using latent semantic indexing of MEDLINE abstracts

Developing a More Accurate Biomedical Literature Retrieval Method using Deep Learning and Citations in PubMed Central Full-text Articles

Manual versus machine: How accurately does the Medical Text Indexer (MTI) classify different document types into disease areas?

Large-Scale Online Semantic Indexing of Biomedical Articles via an Ensemble of Multi-Label Classification Models