Abstract:Purpose This study aimed to investigate how the enrichment of medical documents' index terms by their comments improves the relevance and novelty of the top-ranked results retrieved by an NLP system. Design/methodology/approach A semi-experimental pre-test and post-test research was designed to compare NLP-based indexes before and after being expanded by the comment terms. The experiments were conducted on a test collection of 13,957 documents commented by F1000-Prime reviewers. They were indexed at title, abstract, body and full-text levels. In total, 100 seed documents were randomly selected and served as queries. The textual similarity of the documents and queries was calculated using Lucene-more-like-this function and evaluated by the semantic similarity of their MeSH. The results novelty was measured using maximal marginal relevance and evaluated by their MeSH novelties. Normalized discounted cumulative gain was used to compare the basic and expanded indexes' precisions at 10, 20 and 50 top ranks. Findings The relevance and novelty of the results ranked at the top precision points was improved after expanding the indexes by the comment terms. The finding implies that meta-texts are effective in representing their mother documents, by adding dynamic elements to their rather static contents. It also provides further evidence about the merits of the application of social intelligence and collective wisdom reflected in the actions and reactions of users in tackling the challenges faced by NLP-based systems. Originality/value This is the first study to confirm that social comments on scientific papers improve the performance of information systems in terms of relevance and novelty. Peer review The peer review history for this article is available at: https://publons.com/publon/10.1108/OIR-05-2022-0283.

Enrichissement des contenus par la réindexation des usagers : un état de l'art sur la problématique

Exploiting Community Feedback for Information Retrieval in Dht Networks

Concept-based indexing in text information retrieval

Approche conceptuelle par un processus d'annotation pour la représentation et la valorisation de contenus informationnels en intelligence économique (IE)

An Intelligent Platform For Information Retrieval

Integrating users' needs into multimedia information retrieval system

Using Context to Improve the Evaluation of Information Retrieval Systems

USI: a fast and accurate approach for conceptual document annotation

IRIM - Indexation Et Recherche D'information Multimedia GDR-ISIS

Classement de résultats de recherche grâce au calcul d'une distance d'édition et à l'extraction d'informations documentaires

An Enhanced Indexing And Ranking Technique On The Semantic Web

Représentation de données et métadonnées dans une bibliothèque virtuelle pour une adéquation avec l'usager et les outils de glanage ou moissonnage scientifique

Interprétation vague des contraintes structurelles pour la RI dans des corpus de documents XML - Évaluation d'une méthode approchée de RI structurée

Indexing in the Intellectual Retrieval Environment

Social networks and information retrieval, how are they converging? A survey, a taxonomy and an analysis of social information retrieval approaches and platforms

An End-to-End Efficient Lucene-Based Framework of Document/Information Retrieval

Conception and Use of Ontologies for Indexing and Searching by Semantic Contents of Video Courses

Comment-enriched index terms improve the relevance and novelty of the ranking of the commented medical articles retrieved by an NLP system

Cheap IR Evaluation: Fewer Topics, No Relevance Judgements, and Crowdsourced Assessments

Indexing Medical Images based on Collaborative Experts Reports

Le travail collaboratif dans le cadre d'un projet architectural