Abstract:Background The amount of available textual health data such as scientific and biomedical literature is constantly growing and becoming more and more challenging for health professionals to properly summarize those data and practice evidence-based clinical decision making. Moreover, the exploration of unstructured health text data is challenging for professionals without computer science knowledge due to limited time, resources, and skills. Current tools to explore text data lack ease of use, require high computational efforts, and incorporate domain knowledge and focus on topics of interest with difficulty. Objective We developed a methodology able to explore and target topics of interest via an interactive user interface for health professionals with limited computer science knowledge. We aim to reach near state-of-the-art performance while reducing memory consumption, increasing scalability, and minimizing user interaction effort to improve the clinical decision-making process. The performance was evaluated on diabetes-related abstracts from PubMed. Methods The methodology consists of 4 parts: (1) a novel interpretable hierarchical clustering of documents where each node is defined by headwords (words that best represent the documents in the node), (2) an efficient classification system to target topics, (3) minimized user interaction effort through active learning, and (4) a visual user interface. We evaluated our approach on 50,911 diabetes-related abstracts providing a hierarchical Medical Subject Headings (MeSH) structure, a unique identifier for a topic. Hierarchical clustering performance was compared against the implementation in the machine learning library scikit-learn. On a subset of 2000 randomly chosen diabetes abstracts, our active learning strategy was compared against 3 other strategies: random selection of training instances, uncertainty sampling that chooses instances about which the model is most uncertain, and an expected gradient length strategy based on convolutional neural networks (CNNs). Results For the hierarchical clustering performance, we achieved an F1 score of 0.73 compared to 0.76 achieved by scikit-learn. Concerning active learning performance, after 200 chosen training samples based on these strategies, the weighted F1 score of all MeSH codes resulted in a satisfying 0.62 F1 score using our approach, 0.61 using the uncertainty strategy, 0.63 using the CNN, and 0.45 using the random strategy. Moreover, our methodology showed a constant low memory use with increased number of documents. Conclusions We proposed an easy-to-use tool for health professionals with limited computer science knowledge who combine their domain knowledge with topic exploration and target specific topics of interest while improving transparency. Furthermore, our approach is memory efficient and highly parallelizable, making it interesting for large Big Data sets. This approach can be used by health professionals to gain deep insights into biomedical literature to ultimately improve the evidence-based clinical decision making process.

How scientific literature has been evolving over the time? A novel statistical approach using tracking verbal-based methods

Two Decades of Rheumatology Research (2000-2023): A Dynamic Topic Modeling Perspective

The 'whole landscape' of research on systemic sclerosis over the past 73 years

Global research landscape on antiphospholipid syndrome and systemic lupus erythematosus: Trends, collaborations, and future directions

Linguistic Variation and Change in 250 Years of English Scientific Writing: A Data-Driven Approach

Bibliometric analysis of global literature productivity in systemic lupus erythematosus from 2013 to 2022

Microbial dysbiosis in systemic lupus erythematosus: a scientometric study

Learning the evolution of disciplines from scientific literature: A functional clustering approach to normalized keyword count trajectories

The 100 top-cited studies in systemic lupus erythematosus: A bibliometric analysis

Bibliometric analysis of childhood-onset systemic lupus erythematosus from 2000 to 2022

Systemic lupus erythematosus: one year in review 2024

Improving Diabetes-Related Biomedical Literature Exploration in the Clinical Decision-making Process via Interactive Classification and Topic Discovery: Methodology Development Study

Lupus Registries: Evolution and Challenges

Systemic lupus in the era of machine learning medicine

Large-scale analysis of the medical discourse on rheumatoid arthritis: complementing a socio-anthropologic analysis

Exploring changes in depression and radiology-related publications research focus: A bibliometrics and content analysis based on natural language processing

Bibliometric Perspectives on Medical Innovation using the Medical Subject Headings (MeSH) of PubMed

Hierarchical Dirichlet process for tracking complex topical structure evolution and its application to autism research literature

Exploring Diseases and Syndromes in Neurology Case Reports from 1955 to 2017 with Text Mining

Bibliometric Perspectives on Medical Innovation Using the Medical Subject Headings of PubMed

Social Network Analysis: Bibliographic Network Analysis of the Field and its Evolution / Part 1. Basic Statistics and Citation Network Analysis