Self-citations in around a dozen countries are unusually high

Dalmeet Singh Chawla

DOI: https://doi.org/10.1038/d41586-024-00090-z

IF: 64.8

2024-01-11

Nature

Abstract:Researchers behind the analysis think that policy incentives in these places are to blame. Researchers behind the analysis think that policy incentives in these places are to blame.

multidisciplinary sciences

What problem does this paper attempt to address?

A global exploratory comparison of country self-citations 1996-2019

Alberto Baccini,Eugenio Petrovich

DOI: https://doi.org/10.1371/journal.pone.0294669

2023-11-10

Abstract:Self-citations are a key topic in evaluative bibliometrics because they can artificially inflate citation-related performance indicators. Recently, self-citations defined at the largest scale, i.e., country self-citations, have started to attract the attention of researchers and policymakers. According to a recent research, in fact, the anomalous trends in the country self-citation rates of some countries, such as Italy, have been induced by the distorting effect of citation metrics-centered science policies. In the present study, we investigate the trends of country self-citations in 50 countries over the world in the period 1996-2019 using Scopus data. Results show that for most countries country self-citations have decreased over time. 12 countries (Colombia, Egypt, Indonesia, Iran, Italy, Malaysia, Pakistan, Romania, Russian Federation, Saudi Arabia, Thailand, and Ukraine), however, exhibit different behavior, with anomalous trends of self-citations. We argue that these anomalies should be attributed to the aggressive science policies adopted by these countries in recent years, which are all characterized by direct or indirect incentives for citations. Our analysis confirms that when bibliometric indicators are integrated into systems of incentives, they are capable of affecting rapidly and visibly the citation behavior of entire countries.

Physics and Society,Digital Libraries
Are self-citations a normal feature of knowledge accumulation?

Philippe Vincent-Lamarre,Vincent Larivière

2023-03-05

Abstract:Science is a cumulative activity, which can manifest itself through the act of citing. Citations are also central to research evaluation, thus creating incentives for researchers to cite their own work. Using a dataset containing more than 63 million articles and 51 million disambiguated authors, this paper examines the relative importance of self-citations and self-references in the scholarly communication landscape, their relationship with the age and gender of authors, as well as their effects on various research evaluation indicators. Results show that self-citations and self-references evolve in different directions throughout researchers' careers, and that men and older researchers are more likely to self-cite. Although self-citations have, on average, a small to moderate effect on author's citation rates, they highly inflate citations for a subset of researchers. Comparison of the abstracts of cited and citing papers to assess the relatedness of different types of citations shows that self-citations are more similar to each other than other types of citations, and therefore more relevant. However, researchers that self-reference more tend to include less relevant citations. The paper concludes with a discussion of the role of self-citations in scholarly communication.

Digital Libraries
Self-citation is the hallmark of productive authors, of any gender

Shubhanshu Mishra,Brent D. Fegley,Jana Diesner,Vetle I. Torvik

DOI: https://doi.org/10.1371/journal.pone.0195773

IF: 3.7

2018-09-26

PLoS ONE

Abstract:It was recently reported that men self-cite >50% more often than women across a wide variety of disciplines in the bibliographic database JSTOR. Here, we replicate this finding in a sample of 1.6 million papers from Author-ity, a version of PubMed with computationally disambiguated author names. More importantly, we show that the gender effect largely disappears when accounting for prior publication count in a multidimensional statistical model. Gender has the weakest effect on the probability of self-citation among an extensive set of features tested, including byline position, affiliation, ethnicity, collaboration size, time lag, subject-matter novelty, reference/citation counts, publication type, language, and venue. We find that self-citation is the hallmark of productive authors, of any gender, who cite their novel journal publications early and in similar venues, and more often cross citation-barriers such as language and indexing. As a result, papers by authors with short, disrupted, or diverse careers miss out on the initial boost in visibility gained from self-citations. Our data further suggest that this disproportionately affects women because of attrition and not because of disciplinary under-specialization.

multidisciplinary sciences
A 'home bias' in citations boosts China's global science ranking

Dennis Normile

DOI: https://doi.org/10.1126/science.adt5690

IF: 56.9

2024-10-05

Science

Abstract:Studies find a majority of citations to top-ranked papers produced in China come from within the nation itself

multidisciplinary sciences
Using ISI's 'Highly Cited Researchers' to obtain a country level indicator of citation excellence

Aparna Basu

DOI: https://doi.org/10.1007/s11192-006-0117-x

IF: 3.801

2006-09-01

Scientometrics

Abstract:A high level of citation to an author's work is, in general, a testimony to the fact that the author's work has been noted and used by his peers. High citation is seen to be correlated with other forms of recognition and rewards, and is a key indicator of research performance, among other bibliometric indicators. The Institute for Scientific Information (ISI) defines a 'highly cited researcher' (HCR) as one of 250 most cited authors of journal papers in any discipline. Citation data for 20 years (1981-1999) is used to calculate the share of HCRs for countries in 21 subject areas. We find that the US dominates in all subject areas (US share ~ 40-90%). Based on the number of highly cited researchers in a country, an index of citation excellence is proposed. We find that rank order of countries based on this index is in conformity with our general understanding of research excellence, whereas the more frequently used indicator, citations per paper, gave an unacceptable rank order due to an inherent bias toward very small countries. Additionally, a high value of the index of citation excellence was found to be associated with higher concentration of highly cited researchers in affiliating organizations.

information science & library science,computer science, interdisciplinary applications
A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations

Caspar Chorus,Ludo Waltman

DOI: https://doi.org/10.1371/journal.pone.0161021

IF: 3.7

2016-08-25

PLoS ONE

Abstract:Based on three decades of citation data from across scientific fields of science, we study trends in impact factor biased self-citations of scholarly journals, using a purpose-built and easy to use citation based measure. Our measure is given by the ratio between i) the relative share of journal self-citations to papers published in the last two years, and ii) the relative share of journal self-citations to papers published in preceding years. A ratio higher than one suggests that a journal's impact factor is disproportionally affected (inflated) by self-citations. Using recently reported survey data, we show that there is a relation between high values of our proposed measure and coercive journal self-citation malpractices. We use our measure to perform a large-scale analysis of impact factor biased journal self-citations. Our main empirical result is, that the share of journals for which our measure has a (very) high value has remained stable between the 1980s and the early 2000s, but has since risen strongly in all fields of science. This time span corresponds well with the growing obsession with the impact factor as a journal evaluation measure over the last decade. Taken together, this suggests a trend of increasingly pervasive journal self-citation malpractices, with all due unwanted consequences such as inflated perceived importance of journals and biased journal rankings.

multidisciplinary sciences
Trends in Self-citation Rates in High-impact Neurology, Neuroscience, and Psychiatry Journals

Matthew Rosenblatt,Saloni Mehta,Hannah Peterson,Javid Dadashkarimi,Raimundo X Rodriguez,Maya L Foster,Brendan D Adkinson,Qinghao Liang,Violet M Kimble,Jean Ye,Marie C McCusker,Michael C Farruggia,Max Rolison,Margaret L Westwater,Rongtao Jiang,Stephanie Noble,Dustin Scheinost

DOI: https://doi.org/10.1101/2022.09.27.509533

2024-07-23

Abstract:Citation metrics influence academic reputation and career trajectories. Recent works have highlighted flaws in citation practices in the Neurosciences, such as the under-citation of women. However, self-citation rates--or how much authors cite themselves--have not yet been comprehensively investigated in the Neurosciences. This work characterizes self-citation rates in basic, translational, and clinical Neuroscience literature by collating 100,347 articles from 63 journals between the years 2000-2020. In analyzing over five million citations, we demonstrate four key findings: 1) increasing self-citation rates of Last Authors relative to First Authors, 2) lower self-citation rates in low- and middle-income countries, 3) gender differences in self-citation stemming from differences in the number of previously published papers, and 4) variations in self-citation rates by field. Our characterization of self-citation provides insight into citation practices that shape the perceived influence of authors in the Neurosciences, which in turn may impact what type of scientific research is done and who gets the opportunity to do it.

Neuroscience
The citation black market: schemes selling fake references alarm scientists

Dalmeet Singh Chawla

DOI: https://doi.org/10.1038/d41586-024-01672-7

IF: 64.8

2024-08-22

Nature

Abstract:The ways in which researchers can artificially inflate their reference counts are growing. The ways in which researchers can artificially inflate their reference counts are growing.

multidisciplinary sciences
Citation gaming induced by bibliometric evaluation: a country-level comparative analysis

Alberto Baccini,Giuseppe De Nicolao,Eugenio Petrovich

DOI: https://doi.org/10.1371/journal.pone.0221212

2019-04-09

Abstract:It is several years since national research evaluation systems around the globe started making use of quantitative indicators to measure the performance of researchers. Nevertheless, the effects on these systems on the behavior of the evaluated researchers are still largely unknown. We attempt to shed light on this topic by investigating how Italian researchers reacted to the introduction in 2011 of national regulations in which key passages of professional careers are governed by bibliometric indicators. A new inwardness measure, able to gauge the degree of scientific self-referentiality of a country, is defined as the proportion of citations coming from the country itself compared to the total number of citations gathered by the country. Compared to the trends of the other G10 countries in the period 2000-2016, Italy's inwardness shows a net increase after the introduction of the new evaluation rules. Indeed, globally and also for a large majority of the research fields, Italy became the European country with the highest inwardness. Possible explanations are proposed and discussed, concluding that the observed trends are strongly suggestive of a generalized strategic use of citations, both in the form of author self-citations and of citation clubs. We argue that the Italian case offers crucial insights on the constitutive effects of evaluation systems. As such, it could become a paradigmatic case in the debate about the use of indicators in science-policy contexts.

Digital Libraries
Self-citation and its impact on research evaluation: Literature review. Part I

Vladimir Pislyakov

DOI: https://doi.org/10.48550/arXiv.2109.09192

2021-09-20

Abstract:This review summarizes papers which analyze impact of self-citation on research evaluation. We introduce a generalized definition of self-citation and its variants: author, institutional, country, journal, discipline, publisher self-citation. Formulae of the basic self-citation measures are given, namely self-citing and self-cited rates. World literature on author, institutional, country and journal self-citation is studied in more detail. Current views on the role and impact of self-citation are compiled and analyzed. It is found that there is a general consensus on some points: (a) pathological is as excessive self-citation so its total absence; (b) self-citation has low impact on large science units but may be critical for analysis of individual researchers; (c) share of self-citations is generally higher for units with low bibliometric performance, while top scientists, institutions, journals receive the majority of their citations from outside. This review also considers how bibliometric instruments and databases respond to challenge of possible manipulation by self-citations and how they correct bibliometric indicators calculated by them. The first part of the review presented here deals with the fundamental terms and definitions, and the most discussed and studied type of the self-citation, author self-citation. The paper was funded by RFBR, project number 20-111-50209

Digital Libraries
Self-citation and Citation of Top Journal Publishers and Their Interpretation in the Journal-Discipline Context

Zhou Yangping

DOI: https://doi.org/10.1007/s11192-021-03995-y

IF: 3.801

2021-01-01

Scientometrics

Abstract:The increasing influence of publishers on academic publishing has inevitably promoted studies of publisher citation and self-citation. However, in this type of citation analysis, it is difficult to integrate size dependence and independence among multiple citations and citing articles. We conducted a comprehensive and global study on citation and self-citation at the publisher level and examine the determinants of their different components. Obvious skewness exists in self-citation and citation of the top 20 journal publishers in essential science indicators. Publisher citation significantly correlates with publisher self-citation (PSC) excluding journal self-citation (JSC). Regarding the top 20 journal publishers, we reveal dependency relations of various citations from self-citation to citation and between intradisciplinary and interdisciplinary. JSC integrates with proportion (number), discipline and topic profiles of publisher’s articles and number of publisher’s journals to influence PSC excluding JSC. After exceeding an inflection point related to the JSC rate, the increase in the proportion of articles will become positive for intradisciplinary PSC excluding JSC. Namely, when the JSC rate of a publisher exceeds a value related to its proportion of articles, the increase in its JSC will decrease its intradisciplinary PSC excluding JSC. The increase in the unevenness of the discipline profile of articles can decrease the value of the inflection point and strengthen the effectiveness of the proportion of articles after exceeding the inflection point. In contrast, the increase in the unevenness of the topic profile of articles can increase intradisciplinary PSC excluding JSC regardless of the number of articles. Interdisciplinary PSC is mainly determined by the number of articles. The decrease in the number of journals, from the top 10 to the top 11–20 journal publishers, increases the self-citations in transition statuses between intradisciplinary and interdisciplinary by strengthening the effectiveness of JSC and the number of articles. The topic profile of articles can also directly influence non-self-citation.
Openness and Knowledge Sharing of Economics,Sociology,Law and Politics:A Comparative Study on Citations of Chinese Social Science Journals

Shi Jinchuan,Zhang Yuhao

DOI: https://doi.org/10.3785/j.issn.1008-942X.2011.08.171

2012-01-01

Abstract:As an important part of academic papers which comply with the norms of social science research,citations themselves are of great research value.On the basis of the collection of citation data from top Chinese journals in economics,sociology,law and politics and on the basis of internal and international comparison research,we find that economics and sociology are more open to research abroad while law and politics are less open.And in these subjects,the level of citations to other social sciences is comparatively low.We also find that the percentage of self-citation in economics decreased significantly while that in sociology,law and politics increased moderately between 1998 and 2008 according to the results of the comparison of interdisciplinary citations.On the other hand,the percentage of interdisciplinary citation of sociology and law to economics are quite high,while the percentage of interdisciplinary citation of politics to economics is low.We think that the lack of interdisciplinary journals and the lack of researchers are two key reasons for the underdevelopment of interdisciplinary research in China.
Using Google Scholar to predict self citation: A case study in Health Economics

Richard Norman,Francisco M Couto

DOI: https://doi.org/10.48550/arXiv.1406.5241

2014-06-19

Other Statistics

Abstract:Metrics designed to quantify the influence of academics are increasingly used and easily estimable, and perhaps the most popular is the h index. Metrics such as this are however potentially impacted through excessive self citation. This work explores the issue using a group of researchers working in a well defined sub field of economics, namely Health Economics. It then employs self citation identification software, and identifies the characteristics that best predict self citation. This provides evidence regarding the scale of self citation in the field, and the degree to which self citation impacts on inferences about the relative influence of individual Health Economists. Using data from 545 Health Economists, it suggests self citation to be associated with the geographical region and longevity of the Health Economist, with early career researchers and researchers from mainland Europe and Australasia self citing most frequently.
Uncited articles and their effect on the concentration of citations

Diego Kozlowski1,Jens Peter Andersen,Vincent Larivière

DOI: https://doi.org/10.1002/asi.24852

2023-06-16

Abstract:Empirical evidence demonstrates that citations received by scholarly publications follow a pattern of preferential attachment, resulting in a power-law distribution. Such asymmetry has sparked significant debate regarding the use of citations for research evaluation. However, a consensus has yet to be established concerning the historical trends in citation concentration. Are citations becoming more concentrated in a small number of articles? Or have recent geopolitical and technical changes in science led to more decentralized distributions? This ongoing debate stems from a lack of technical clarity in measuring inequality. Given the variations in citation practices across disciplines and over time, it is crucial to account for multiple factors that can influence the findings. This article explores how reference-based and citation-based approaches, uncited articles, citation inflation, the expansion of bibliometric databases, disciplinary differences, and self-citations affect the evolution of citation concentration. Our results indicate a decreasing trend in citation concentration, primarily driven by a decline in uncited articles, which, in turn, can be attributed to the growing significance of Asia and Europe. On the whole, our findings clarify current debates on citation concentration and show that, contrary to a widely-held belief, citations are increasingly scattered.

Digital Libraries,Computers and Society,Physics and Society
Is There A Clubbing Effect Underlying Chinese Research Citation Increases?

Li Tang,Philip Shapira,Jan Youtie

DOI: https://doi.org/10.1002/asi.23302

2015-01-01

Journal of the Association for Information Science and Technology

Abstract:There is increasing evidence that citations to Chinese research publications are rising sharply. A series of reasons have been highlighted in previous studies. This research explores another possibilitywhether there is a clubbing effect in China's surge in research citations, in which a higher rate of internal citing takes place among influential Chinese researchers. Focusing on the most highly cited research articles in nanotechnology, we find that a larger proportion of Chinese nanotechnology research citations are localized within individual, institutional, and national networks within China. Both descriptive and statistical tests suggest that highly cited Chinese papers are more likely than similar U.S. papers to receive internal and localized citations. Tentative explanations and policy implications are discussed.
Illusion of Increased Research Quality? A Clubbing Effect Analysis of China's Research

Li Tang

DOI: https://doi.org/10.5465/ambpp.2014.10810abstract

2014-01-01

Abstract:There is increasing evidence that citations to Chinese research are rising sharply. A variety of explanations have been explored in previous studies. This research aims to explore another potential explanation ¨C whether there exists a
The false myth of the rise in self-citations, and the impressively positive effect of bibliometric evaluations on the increase of the impact of Italian research

Pietro D'Antuono,Michele Ciavarella

DOI: https://doi.org/10.48550/arXiv.1910.02948

2019-10-07

Abstract:It has recently been claimed by Baccini and coauthors that due to ANVUR's bibliometric evaluations of individuals, departments, and universities, in Italy there has been a surge in self-citations in the last ten years, thus increasing the "inwardness" of Italian research more than has happened abroad. We have studied the database of Ioannidis et al. published on 12 August 2019 of the one hundred thousand most "highly cited" scientists, including about two thousand Italians, and we found that the problem of self-citations in relation to this scientific elite is not significant in Italy, while perhaps observing a small deviation in the low scores in the rankings. The effect indicated by Baccini et al. consequently, does not seem worrying for the scientific elite (we quantified it in 2 percent of the total of scientists of the "best" one hundred thousand), and is probably largely concentrated in the further less cited scientists. Evaluation agencies like ANVUR should probably exclude self-citations in future evaluations, for the noise introduced by the young researchers. The overall state of health of the Italian research system and the positive effect of the ANVUR assessments are demonstrated by the number of Italian researchers in the top one hundred thousand, which has increased by comparing the "career" databased of 22 years, with that of the "young" researchers in the "2017" database. Italy, looking at the elite researchers, not only is not the most indulgent in self-citations, but has shown the best improvements, proving that the introduction of ANVUR had a positive effect. Indeed, all countries apart from Italy have suffered a decline, even substantial (-20 percent on a national Japan scale), of the number of researchers present in the 2017 data sets compared to career data. Italy instead shows a +0.2 percent on a global basis and an impressive +11.53 percent on a national basis.

Digital Libraries,Physics and Society
Who Re-Uses Data? A Bibliometric Analysis of Dataset Citations

Geoff Krause,Madelaine Hare,Mike Smit,Philippe Mongeon

2023-08-09

Abstract:Open data is receiving increased attention and support in academic environments, with one justification being that shared data may be re-used in further research. But what evidence exists for such re-use, and what is the relationship between the producers of shared datasets and researchers who use them? Using a sample of data citations from OpenAlex, this study investigates the relationship between creators and citers of datasets at the individual, institutional, and national levels. We find that the vast majority of datasets have no recorded citations, and that most cited datasets only have a single citation. Rates of self-citation by individuals and institutions tend towards the low end of previous findings and vary widely across disciplines. At the country level, the United States is by far the most prominent exporter of re-used datasets, while importation is more evenly distributed. Understanding where and how the sharing of data between researchers, institutions, and countries takes place is essential to developing open research practices.

Digital Libraries
Macro-indicators of Citation Impacts of Six Prolific Countries: InCites Data and the Statistical Significance of Trends.

Lutz Bornmann,Loet Leydesdorff

DOI: https://doi.org/10.1371/journal.pone.0056768

IF: 3.7

2013-01-01

PLoS ONE

Abstract:Using the InCites tool of Thomson Reuters, this study compares normalized citation impact values calculated for China, Japan, France, Germany, United States, and the UK throughout the time period from 1981 to 2010. InCites offers a unique opportunity to study the normalized citation impacts of countries using (i) a long publication window (1981 to 2010), (ii) a differentiation in (broad or more narrow) subject areas, and (iii) allowing for the use of statistical procedures in order to obtain an insightful investigation of national citation trends across the years. Using four broad categories, our results show significantly increasing trends in citation impact values for France, the UK, and especially Germany across the last thirty years in all areas. The citation impact of papers from China is still at a relatively low level (mostly below the world average), but the country follows an increasing trend line. The USA exhibits a stable pattern of high citation impact values across the years. With small impact differences between the publication years, the US trend is increasing in engineering and technology but decreasing in medical and health sciences as well as in agricultural sciences. Similar to the USA, Japan follows increasing as well as decreasing trends in different subject areas, but the variability across the years is small. In most of the years, papers from Japan perform below or approximately at the world average in each subject area.
The Impacts of Incentives for International Publications on Research Cultures in Chinese Humanities and Social Sciences

Xin Xu,Alis Oancea,Heath Rose

DOI: https://doi.org/10.1007/s11024-021-09441-w

IF: 2.356

2021-04-06

Minerva

Abstract:Abstract Incentives for improving research productivity at universities prevail in global academia. However, the rationale, methodology, and impact of such incentives and consequent evaluation regimes are in need of scrutinization. This paper explores the influences of financial and career-related publishing incentive schemes on research cultures. It draws on an analysis of 75 interviews with academics, senior university administrators, and journal editors from China, a country that has seen widespread reliance on international publication counts in research evaluation and reward systems. The study focuses on humanities and social sciences (HSS) as disciplinary sites, which embody distinct characteristics and have experienced the introduction of incentive schemes in China since the early 2000s. Findings reveal tensions between internationalization and indigenization, quality and quantity, integrity and instrumentalism, equity and inequity in Chinese academia. In particular, we argue that a blanket incentive scheme could reinforce a managerial culture in higher education, encourage performative objectification of academics, and jeopardize their agency. We thereby challenge ‘one-size-fits-all’ policymaking, and suggest instead that institutions should have the opportunity to adopt an ethical and ‘human-oriented’ approach when developing their research incentives and evaluation mechanisms.

education & educational research,history & philosophy of science,social sciences, interdisciplinary

Self-citations in around a dozen countries are unusually high

A global exploratory comparison of country self-citations 1996-2019

Are self-citations a normal feature of knowledge accumulation?

Self-citation is the hallmark of productive authors, of any gender

A 'home bias' in citations boosts China's global science ranking

Using ISI's 'Highly Cited Researchers' to obtain a country level indicator of citation excellence

A Large-Scale Analysis of Impact Factor Biased Journal Self-Citations

Trends in Self-citation Rates in High-impact Neurology, Neuroscience, and Psychiatry Journals

The citation black market: schemes selling fake references alarm scientists

Citation gaming induced by bibliometric evaluation: a country-level comparative analysis

Self-citation and its impact on research evaluation: Literature review. Part I

Self-citation and Citation of Top Journal Publishers and Their Interpretation in the Journal-Discipline Context

Openness and Knowledge Sharing of Economics,Sociology,Law and Politics:A Comparative Study on Citations of Chinese Social Science Journals

Using Google Scholar to predict self citation: A case study in Health Economics

Uncited articles and their effect on the concentration of citations

Is There A Clubbing Effect Underlying Chinese Research Citation Increases?

Illusion of Increased Research Quality? A Clubbing Effect Analysis of China's Research

The false myth of the rise in self-citations, and the impressively positive effect of bibliometric evaluations on the increase of the impact of Italian research

Who Re-Uses Data? A Bibliometric Analysis of Dataset Citations

Macro-indicators of Citation Impacts of Six Prolific Countries: InCites Data and the Statistical Significance of Trends.

The Impacts of Incentives for International Publications on Research Cultures in Chinese Humanities and Social Sciences