How Can Journal Impact Factors Be Normalized Across Fields of Science? an Assessment in Terms of Percentile Ranks and Fractional Counts

Loet Leydesdorff,Ping Zhou,Lutz Bornmann
DOI: https://doi.org/10.1002/asi.22765
2012-01-01
Abstract:Using the CD ‐ ROM version of the S cience C itation I ndex 2010 ( N = 3,705 journals), we study the (combined) effects of (a) fractional counting on the impact factor ( IF ) and (b) transformation of the skewed citation distributions into a distribution of 100 percentiles and six percentile rank classes (top‐1%, top‐5%, etc.). Do these approaches lead to field‐normalized impact measures for journals? In addition to the 2‐year IF ( IF 2), we consider the 5‐year IF ( IF 5), the respective numerators of these IFs , and the number of T otal C ites, counted both as integers and fractionally. These various indicators are tested against the hypothesis that the classification of journals into 11 broad fields by P atent B oard/ NSF ( N ational S cience F oundation) provides statistically significant between‐field effects. Using fractional counting the between‐field variance is reduced by 91.7% in the case of IF 5, and by 79.2% in the case of IF 2. However, the differences in citation counts are not significantly affected by fractional counting. These results accord with previous studies, but the longer citation window of a fractionally counted IF 5 can lead to significant improvement in the normalization across fields.
What problem does this paper attempt to address?