The New Excellence Indicator in the World Report of the SCImago Institutions Rankings 2011

Lutz Bornmann,Felix de Moya Anegon,Loet Leydesdorff
DOI: https://doi.org/10.1016/j.joi.2011.11.006
IF: 3.7
2012-01-01
Journal of Informetrics
Abstract:The new excellence indicator in the World Report of the SCImago Institutions Rankings (SIR) makes it possible to test differences in the ranking in terms of statistical significance. For example, at the 17th position of these rankings, UCLA has an output of 37,994 papers with an excellence indicator of 28.9. Stanford University follows at the 19th position with 37,885 papers and 29.1 excellence, and z = - 0.607. The difference between these two institution thus is not statistically significant. We provide a calculator at http://www.leydesdorff.net/scimago11/scimago11.xls in which one can fill out this test for any two institutions and also for each institution on whether its score is significantly above or below expectation (assuming that 10 papers are for stochastic reasons in the top-10
What problem does this paper attempt to address?