Unpacking Research Contributions: Investigation from Contextual and Processual Perspectives.

Zhe Cao,Yuanyuan Shang,Lin Zhang ,Ying Huang
DOI: https://doi.org/10.1007/978-3-031-57860-1_23
2024-01-01
Abstract:Traditionally, scientific evaluation leaning on quantity and citation metrics rarely places a study within a specific context or a particular historical process for examination, making it difficult to fully reveal its substantial contributions. In a specific scientific field, each study focuses on a certain topic and corresponds to a certain evolutionary stage of the topic. However, few studies analyze research contributions from context-oriented and process-oriented perspectives. This study investigates the contributions of research under several representative topics in the field of quantitative science studies, using articles published in the international journal Scientometrics as samples. BERTopic model is employed for topic clustering, and four research topics are selected for in-depth analysis. In order to unveil research contributions to knowledge production and to different audiences, various metrics including disruptiveness, citation impact and altmetrics are combined for indicator-level analysis, and articles are classified into different categories according to the knowledge contribution types and research orientations for content-level analysis. Results reveal that representative research topics exhibit greater disruptiveness and research impact compared to the overall sample. However, as research topics develop, there is a declining trend in introducing new knowledge and producing impact within academia. Simultaneously, there is a certain degree of enhancement in their impact beyond academia, and also a shift in knowledge contribution types and research orientations. Our findings contribute to a contextual and processual understanding of diverse research contributions, serving as a reference for the evaluation practices of research outcomes oriented towards contribution assessment.
What problem does this paper attempt to address?