Abstract:Quantifying and comparing the scientific output of researchers has become critical for governments, funding agencies and universities. Comparison by reputation and direct assessment of contributions to the field is no longer possible, as the number of scientists increases and traditional definitions about scientific fields become blurred. The h-index is often used for comparing scientists, but has several well-documented shortcomings. In this paper, we introduce a new index for measuring and comparing the publication records of scientists: the pagerank-index (symbolised as π). The index uses a version of pagerank algorithm and the citation networks of papers in its computation, and is fundamentally different from the existing variants of h-index because it considers not only the number of citations but also the actual impact of each citation. We adapt two approaches to demonstrate the utility of the new index. Firstly, we use a simulation model of a community of authors, whereby we create various 'groups' of authors which are different from each other in inherent publication habits, to show that the pagerank-index is fairer than the existing indices in three distinct scenarios: (i) when authors try to 'massage' their index by publishing papers in low-quality outlets primarily to self-cite other papers (ii) when authors collaborate in large groups in order to obtain more authorships (iii) when authors spend most of their time in producing genuine but low quality publications that would massage their index. Secondly, we undertake two real world case studies: (i) the evolving author community of quantum game theory, as defined by Google Scholar (ii) a snapshot of the high energy physics (HEP) theory research community in arXiv. In both case studies, we find that the list of top authors vary very significantly when h-index and pagerank-index are used for comparison. We show that in both cases, authors who have collaborated in large groups and/or published less impactful papers tend to be comparatively favoured by the h-index, whereas the pagerank-index highlights authors who have made a relatively small number of definitive contributions, or written papers which served to highlight the link between diverse disciplines, or typically worked in smaller groups. Thus, we argue that the pagerank-index is an inherently fairer and more nuanced metric to quantify the publication records of scientists compared to existing measures.

Research on the Evaluation of Scientists Based on Weighted h-index

Statistical Model of Scientific Research Evaluation

Quantitative analysis of automatic performance evaluation systems based on the h-index

Which h-index? An exploration within the Web of Science

A WoS-based Positive Study on the h-index of Scientists in Natural Sciences

Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors

Applicability of H-index in evaluating Chinese scientists

Comparative Study on H-index Correlative Factors of Journal Papers Published by University Library

Analysis of Scholars' influence evaluation Based on Data collection and integration in the Context of Big Data: –– Taking the Hospital Scientific Research Output Database as an Example

Author Evaluation Based on H-index and Citation Response

The x-index: A new citation-distance-based index to measure academic influence

In Those Fields Where Multiple Authorship Is The Rule, The H-Index Should Be Supplemented By Role-Based H-Indices

Top Cited Articles in Adsorption Research Using Y-Index

Weighted citation based on ranking-related contribution: a new index for evaluating article impact

A CSSCI-based Positive Study on the H-index of Scholars in Humanities and Social Sciences

Correlation of the Hirsch-index With Evaluation System of Academic Ranking

Review on Calculating Methods of h-index Based on Co-authorship

The Pagerank-Index: Going beyond Citation Counts in Quantifying Scientific Impact of Researchers

Empirical Research on Schubert's H-Index of a Single Paper——Taking the Library and Information Science as Examples

Evaluation index system for academic papers of humanities and social sciences

A Quantitative Evaluation System of Chinese Journals in the Humanities and Social Sciences