Citing is earlier than Cited?

Xian Li

DOI: https://doi.org/10.48550/arXiv.2006.03767

2020-06-06

Abstract:Generally, it is common that cited papers are earlier than citing papers. But we found three different cases, with more undiscovered. In this letter, we attempted to explain the reasons. However, negative time lag between citing and cited papers may mislead us when we study the characteristics of science.

Digital Libraries,Information Theory

What problem does this paper attempt to address?

Patent Citations to Scientific Papers As Early Signs for Predicting Delayed Recognition of Scientific Discoveries: a Comparative Study with Instant Recognition.

Jian Du,Peixin Li,Robin Haunschild,Yinan Sun,Xiaoli Tang

2019-01-01

Abstract:In this study, we investigate the extent to that patent citations to papers can serve as early signs for predicting delayed recognition using a comparative study with a control group, i.e., instant recognition papers. We identify the two opposite groups of papers by the Bcp measure, a parameter-free index for identifying papers which were recognized with delay (also called "sleeping beauties" in science). Combined with a typical case study, it appears that papers with delayed recognition show a stronger and longer technical impact than instant recognition papers. We provide indication that in the more recent years papers with delayed recognition are awakened more often and more earlier by a patent rather than by a scientific paper (also called "prince"). We also found that patent citations seem to play an important role to avoid instant recognition papers to level off or to become a so called "flash in the pan". it also appears that the sleeping beauties may firstly encounter negative citations and then patent citations and finally get widely recognized. In contrast to the two focus fields (biology and chemistry) for instant recognition papers, delayed recognition papers are rather evenly distributed in biology, chemistry, psychology, geology, materials science, and physics. We discovered several pairs of "science sleeping"-"technology inducing", such as biology-biotechnology/pharmaceuticals, chemistry-chemical engineering, psychology-computer/control technology, and physics-computer technology. We propose in further research to discover the potential ahead of time and transformative research by using citation delay analysis, patent & NPI. analysis, and citation context analysis.
The Time Dimension of Science: Connecting the Past to the Future

Yian Yin,Dashun Wang

DOI: https://doi.org/10.1016/j.joi.2017.04.002

2017-04-19

Abstract:A central question in science of science concerns how time affects citations. Despite the long-standing interests and its broad impact, we lack systematic answers to this simple yet fundamental question. By reviewing and classifying prior studies for the past 50 years, we find a significant lack of consensus in the literature, primarily due to the coexistence of retrospective and prospective approaches to measuring citation age distributions. These two approaches have been pursued in parallel, lacking any known connections between the two. Here we developed a new theoretical framework that not only allows us to connect the two approaches through precise mathematical relationships, it also helps us reconcile the interplay between temporal decay of citations and the growth of science, helping us uncover new functional forms characterizing citation age distributions. We find retrospective distribution follows a lognormal distribution with exponential cutoff, while prospective distribution is governed by the interplay between a lognormal distribution and the growth in the number of references. Most interestingly, the two approaches can be connected once rescaled by the growth of publications and citations. We further validate our framework using both large-scale citation datasets and analytical models capturing citation dynamics. Together this paper presents a comprehensive analysis of the time dimension of science, representing a new empirical and theoretical basis for all future studies in this area.

Physics and Society,Digital Libraries,Social and Information Networks
From Zero to One: A Perspective on Citing.

Yong Huang,Yi Bu,Ying Ding,Wei Lu

DOI: https://doi.org/10.1002/asi.24177

2019-01-01

Journal of the Association for Information Science and Technology

Abstract:This article investigates the lengths of time that publications with different numbers of citations take to receive their first citation (the beginning stage), and then compares the lengths of time to receive two or more citations after receiving the first citation (the accumulative stage) in the field of computer science. We find that in the beginning stage, that is, from zero to one citation, high‐, medium‐, and low‐cited publications do not obviously exhibit different lengths of time. However, in the accumulative stage, that is, from one to N citations, highly cited publications begin to receive citations much more rapidly than medium‐ and low‐cited publications. Moreover, as N increases, the difference in receiving new citations among high‐, medium‐, and low‐cited publications increases quite significantly.
A Comparative Study of Domestic and Cross‐country Impact of Chinese and U.S. Publications in Chemistry

Xiaojing Cai,Xiaozan Lyu,Ping Zhou

DOI: https://doi.org/10.1002/pra2.5

2019-01-01

Abstract:ABSTRACTBased on publications in Chemistry in 2015, this paper investigated the citation impact on domestic and foreign scholarly communities of Chinese and US publications, and to what extent does such impact relate to international collaboration and government funding. First‐ or corresponding authorship in international collaboration is defined as dominance and is taken into consideration. Citations to publications are designated as domestic citations (Chinese or US citations), partner citations or other citations according to overlap of countries of citing and cited publications. Significant difference exists in the two countries. Most citations of Chinese publications are from domestic and partner countries, with domestic citations being the mainstay. In contrast, US papers receive more other citations than domestic or partner citations, and citations from partner countries contribute significantly. US papers have higher global impact than those of China. High domestic citation propensity is associated with non‐international collaboration, dominance of focal country in international collaboration, and national funding support. Such phenomenon is more pronounced in Chinese papers. In other words, citation impact of Chinese publications is more limited in domestic community, whereas that of the US is more global.
A Primary Study on Negative Citation in Citation Data

Ye Jiyuan,Yuan Peiguo,Wu Xiangdong

DOI: https://doi.org/10.16810/j.cnki.1672-514x.2007.06.009

2007-01-01

Abstract:Basing on some related datum of Sino-foreign science citation databases and spot checking examples,this paper analyses the proportion that carring on the back cited in the total time of citation and believes that when the citation datum are big enough,the effect that carring on the back cites decreases relatively.It proposes that when citation datum are applied to the evaluating,we should ask specialist to read carefully the cited context,so as to get rid of the obvious back cites.The cited datum should be correctly approached. Neither overestimating,nor overlooking.
The relationship between interdisciplinarity and citation impact-a novel perspective on citation accumulation

Xiaojing Cai,Xiaozan Lyu,Ping Zhou

DOI: https://doi.org/10.1057/s41599-023-02475-3

2023-01-01

Abstract:Interdisciplinary research is of significance for creating breakthroughs and facilitating innovations and may achieve higher citation impact, although contrary results still exist. The current study looks into the relationship between interdisciplinarity and citation impact from a brand-new perspective-the process of citation accumulation-by exploring how interdisciplinarity, as measured by Rao-Stirling and DIV, affects the accumulating process of citations, based on scientific papers published by Chinese or US authors in 2009-2011 in Chemistry. Two metrics are used to measure how long it takes for a paper to reach its citation peak (PEAK_YEAR) and how sustainable the citation impact remains after the peak (SUS). The results show that compared with Rao-Stirling, DIV is more sensitive to the length of the citation window and more closely aligned with the nature of interdisciplinarity. In Chemistry, higher interdisciplinarity is more likely to encounter delayed recognition and greater citation sustainability, which may explain the inconsistency in the relationship between interdisciplinarity and citation impact. In conclusion, it is necessary to consider the length of the citation window when explaining the relationship between interdisciplinarity and citation impact. A longer citation window may be a better solution, as an alternative or supplement, in assessing the academic performance of interdisciplinary research.
Contradistinctive Analyses on Cited Delays of Chinese SCI Articles

ZHANG Zhi-min,Yu Guang,GAO Han-xiang

DOI: https://doi.org/10.16192/j.cnki.1003-2053.2010.09.007

2010-01-01

Abstract:The citation data of scientific literature can be used to measure a flow of knowledge.In this paper,citation data of Chinese scientific papers is quantitatively analyzed according to Science citation index database.Analysis results show current and shortage in Chinese science technology by changes of cited delay characteristic parameters.It is effectual that these results will provided some scientific bases for establishing national scientific management policies.
Editorial Delay and Its Relation to Subsequent Citations: the Journals Nature , Science and Cell

Si Shen,Ronald Rousseau,Dongbo Wang,Danhao Zhu,Huoyu Liu,Ruilun Liu

DOI: https://doi.org/10.1007/s11192-015-1592-8

IF: 3.801

2015-01-01

Scientometrics

Abstract:This investigation tries to determine if, for highly visible journals, namely Nature, Science and Cell, articles with a short editorial delay time generally, receive more citations than those with a long editorial delay. Based on data for the period from 2005 to 2009, it is found that there is a clear, although statistically weak, tendency for an inverse relation between editorial delay time and number of received citations.
Openness and Knowledge Sharing of Economics,Sociology,Law and Politics:A Comparative Study on Citations of Chinese Social Science Journals

Shi Jinchuan,Zhang Yuhao

DOI: https://doi.org/10.3785/j.issn.1008-942X.2011.08.171

2012-01-01

Abstract:As an important part of academic papers which comply with the norms of social science research,citations themselves are of great research value.On the basis of the collection of citation data from top Chinese journals in economics,sociology,law and politics and on the basis of internal and international comparison research,we find that economics and sociology are more open to research abroad while law and politics are less open.And in these subjects,the level of citations to other social sciences is comparatively low.We also find that the percentage of self-citation in economics decreased significantly while that in sociology,law and politics increased moderately between 1998 and 2008 according to the results of the comparison of interdisciplinary citations.On the other hand,the percentage of interdisciplinary citation of sociology and law to economics are quite high,while the percentage of interdisciplinary citation of politics to economics is low.We think that the lack of interdisciplinary journals and the lack of researchers are two key reasons for the underdevelopment of interdisciplinary research in China.
Citing for High Impact

Xiaolin Shi,Jure Leskovec,Daniel A. McFarland

DOI: https://doi.org/10.48550/arXiv.1004.3351

2010-04-20

Abstract:The question of citation behavior has always intrigued scientists from various disciplines. While general citation patterns have been widely studied in the literature we develop the notion of citation projection graphs by investigating the citations among the publications that a given paper cites. We investigate how patterns of citations vary between various scientific disciplines and how such patterns reflect the scientific impact of the paper. We find that idiosyncratic citation patterns are characteristic for low impact papers; while narrow, discipline-focused citation patterns are common for medium impact papers. Our results show that crossing-community, or bridging citation patters are high risk and high reward since such patterns are characteristic for both low and high impact papers. Last, we observe that recently citation networks are trending toward more bridging and interdisciplinary forms.

Digital Libraries
The Role of Positive and Negative Citations in Scientific Evaluation

Xiaomei Bai,Ivan Lee,Zhaolong Ning,Amr Tolba,Feng Xia

DOI: https://doi.org/10.48550/arXiv.2008.03844

2020-08-10

Abstract:Quantifying the impact of scientific papers objectively is crucial for research output assessment, which subsequently affects institution and country rankings, research funding allocations, academic recruitment and national/international scientific priorities. While most of the assessment schemes based on publication citations may potentially be manipulated through negative citations, in this study, we explore Conflict of Interest (COI) relationships and discover negative citations and subsequently weaken the associated citation strength. PANDORA (Positive And Negative COI- Distinguished Objective Rank Algorithm) has been developed, which captures the positive and negative COI, together with the positive and negative suspected COI relationships. In order to alleviate the influence caused by negative COI relationship, collaboration times, collaboration time span, citation times and citation time span are employed to determine the citing strength; while for positive COI relationship, we regard it as normal citation relationship. Furthermore, we calculate the impact of scholarly papers by PageRank and HITS algorithms, based on a credit allocation algorithm which is utilized to assess the impact of institutions fairly and objectively. Experiments are conducted on the publication dataset from American Physical Society (APS) dataset, and the results demonstrate that our method significantly outperforms the current solutions in Recommendation Intensity of list R at top-K and Spearman's rank correlation coefficient at top-K.

Digital Libraries,Information Retrieval
Research on the Phenomenon of Articles'Delayed Citation

WANG Mingyang,YU Guang,Yu Daren

DOI: https://doi.org/10.3969/j.issn.1002-1965.2011.05.014

IF: 3.1759

2011-01-01

Journal of Intelligence

Abstract:In this paper,the phenomenon of articles' delayed citation is discussed.It is found that delayed citation is never to be the shifting of articles' citation distribution in time-base and the delayed citation has a great influence upon the articles' later citations.The attention paid to the articles will be reduced accordingly with their delayed citation.
Forgotten Knowledge: Examining the Citational Amnesia in NLP

Janvijay Singh,Mukund Rungta,Diyi Yang,Saif M. Mohammad

2023-08-01

Abstract:Citing papers is the primary method through which modern scientific writing discusses and builds on past work. Collectively, citing a diverse set of papers (in time and area of study) is an indicator of how widely the community is reading. Yet, there is little work looking at broad temporal patterns of citation. This work systematically and empirically examines: How far back in time do we tend to go to cite papers? How has that changed over time, and what factors correlate with this citational attention/amnesia? We chose NLP as our domain of interest and analyzed approximately 71.5K papers to show and quantify several key trends in citation. Notably, around 62% of cited papers are from the immediate five years prior to publication, whereas only about 17% are more than ten years old. Furthermore, we show that the median age and age diversity of cited papers were steadily increasing from 1990 to 2014, but since then, the trend has reversed, and current NLP papers have an all-time low temporal citation diversity. Finally, we show that unlike the 1990s, the highly cited papers in the last decade were also papers with the least citation diversity, likely contributing to the intense (and arguably harmful) recency focus. Code, data, and a demo are available on the project homepage.

Computation and Language,Digital Libraries
Are self-citations a normal feature of knowledge accumulation?

Philippe Vincent-Lamarre,Vincent Larivière

2023-03-05

Abstract:Science is a cumulative activity, which can manifest itself through the act of citing. Citations are also central to research evaluation, thus creating incentives for researchers to cite their own work. Using a dataset containing more than 63 million articles and 51 million disambiguated authors, this paper examines the relative importance of self-citations and self-references in the scholarly communication landscape, their relationship with the age and gender of authors, as well as their effects on various research evaluation indicators. Results show that self-citations and self-references evolve in different directions throughout researchers' careers, and that men and older researchers are more likely to self-cite. Although self-citations have, on average, a small to moderate effect on author's citation rates, they highly inflate citations for a subset of researchers. Comparison of the abstracts of cited and citing papers to assess the relatedness of different types of citations shows that self-citations are more similar to each other than other types of citations, and therefore more relevant. However, researchers that self-reference more tend to include less relevant citations. The paper concludes with a discussion of the role of self-citations in scholarly communication.

Digital Libraries
Paper-Patent Citation Linkages as Early Signs for Predicting Delayed Recognized Knowledge: Macro and Micro Evidence

Jian Du,Peixin Li,Robin Haunschild,Yinan Sun,Xiaoli Tang

DOI: https://doi.org/10.48550/arXiv.1906.07953

2020-01-20

Abstract:In this study, we investigate the extent to which patent citations to papers can serve as early signs for predicting delayed recognized knowledge in science using a comparative study with a control group, i.e., instant recognition papers. We identify the two opposite groups of papers by the Bcp measure, a parameter-free index for identifying papers which were recognized with delay. We provide a macro (Science/Nature papers dataset) and micro (a case chosen from the dataset) evidence on paper-patent citation linkages as early signs for predicting delayed recognized knowledge in science. It appears that papers with delayed recognition show a stronger and longer technical impact than instant recognition papers. We provide indication that in the more recent years papers with delayed recognition are awakened more often and earlier by a patent rather than by a scientific paper (also called "prince"). We also found that patent citations seem to play an important role to avoid instant recognition papers to level off or to become a so called "flash in the pan", i.e., instant recognition. It also appears that the sleeping beauties may firstly encounter negative citations and then patent citations and finally get widely recognized. In contrast to the two focused fields (biology and chemistry) for instant recognition papers, delayed recognition papers are rather evenly distributed in biology, chemistry, psychology, geology, materials science, and physics. We discovered several pairs of "science sleeping"-"technology [...]. We propose in further research to discover the potential ahead of time and transformative research by using citation delay analysis, patent & NPL analysis, and citation context analysis.

Digital Libraries
Is there really a Citation Age Bias in NLP?

Hoa Nguyen,Steffen Eger

2024-01-08

Abstract:Citations are a key ingredient of scientific research to relate a paper to others published in the community. Recently, it has been noted that there is a citation age bias in the Natural Language Processing (NLP) community, one of the currently fastest growing AI subfields, in that the mean age of the bibliography of NLP papers has become ever younger in the last few years, leading to `citation amnesia' in which older knowledge is increasingly forgotten. In this work, we put such claims into perspective by analyzing the bibliography of $\sim$300k papers across 15 different scientific fields submitted to the popular preprint server Arxiv in the time period from 2013 to 2022. We find that all AI subfields (in particular: cs.AI, cs.CL, cs.CV, cs.LG) have similar trends of citation amnesia, in which the age of the bibliography has roughly halved in the last 10 years (from above 12 in 2013 to below 7 in 2022), on average. Rather than diagnosing this as a citation age bias in the NLP community, we believe this pattern is an artefact of the dynamics of these research fields, in which new knowledge is produced in ever shorter time intervals.

Digital Libraries,Artificial Intelligence,Computation and Language
Delayed Citation Impact of Interdisciplinary Research

Yang Zhang,Yang Wang,Haifeng Du,Shlomo Havlin

DOI: https://doi.org/10.1016/j.joi.2023.101468

IF: 3.7

2024-01-01

Journal of Informetrics

Abstract:Interdisciplinary research increasingly fuels innovation, and is a key input for future breakthroughs. Yet the timing of when interdisciplinary research achieves its highest citation impact remains unclear. Here, we use the time of a paper to reach its citation peak to quantify citation dynamics, and examine its relationship with paper interdisciplinarity. Using large scale publication datasets spanning over 37 years, our results suggest that interdisciplinary papers show significant delayed citation impact both at the individual paper level and collectively, as it takes longer for highly interdisciplinary papers to reach their citation peak as well as their half citations. Such relationships are nearly universal across various scientific disciplines and time periods. Furthermore, we study the underlying forces behind this delayed impact, finding that the effect goes beyond the Matthew effect (i.e., the rich-get-richer effect). Although team size and content conventionality are partly related to the citation delay, they cannot fully explain this effect. Overall, our results suggest that governments, research administrators, and funding agencies should be aware of this general feature of interdisciplinary science, which may have broad policy implications.
Hidden Citations Obscure True Impact in Science

Xiangyi Meng,Onur Varol,Albert-László Barabási

2024-05-12

Abstract:References, the mechanism scientists rely on to signal previous knowledge, lately have turned into widely used and misused measures of scientific impact. Yet, when a discovery becomes common knowledge, citations suffer from obliteration by incorporation. This leads to the concept of hidden citation, representing a clear textual credit to a discovery without a reference to the publication embodying it. Here, we rely on unsupervised interpretable machine learning applied to the full text of each paper to systematically identify hidden citations. We find that for influential discoveries hidden citations outnumber citation counts, emerging regardless of publishing venue and discipline. We show that the prevalence of hidden citations is not driven by citation counts, but rather by the degree of the discourse on the topic within the text of the manuscripts, indicating that the more discussed is a discovery, the less visible it is to standard bibliometric analysis. Hidden citations indicate that bibliometric measures offer a limited perspective on quantifying the true impact of a discovery, raising the need to extract knowledge from the full text of the scientific corpus.

Computation and Language,Digital Libraries,Social and Information Networks,Physics and Society
The citation advantage of foreign language references for Chinese social science papers

Kaile Gong,Juan Xie,Ying Cheng,Vincent Larivière,Cassidy R. Sugimoto

DOI: https://doi.org/10.48550/arXiv.1908.07576

2019-08-20

Digital Libraries

Abstract:Contemporary scientific exchanges are international, yet language continues to be a persistent barrier to scientific communication, particularly for non-native English-speaking scholars. Since the ability to absorb knowledge has a strong impact on how researchers create new scientific knowledge, a comprehensive access to and understanding of both domestic and international scientific publications is essential for scientific performance. This study explores the effect of absorbed knowledge on research impact by analyzing the relationship between the language diversity of cited references and the number of citations received by the citing paper. Chinese social sciences are taken as the research object, and the data, 950,302 papers published between 1998 and 2013 with 8,151,327 cited references, were collected from the Chinese Social Sciences Citation Index. Results show that there is a stark increase in the consumption of foreign language material within the Chinese social science community, and English material accounts for the vast majority of this consumption. Papers with foreign language references receive significantly more citations than those without, and the citation advantage of these internationalized work holds when we control for characteristics of the citing papers. However, the citation advantage has decreased from 1998 to 2008, largely as an artifact of the increased number of papers citing foreign language material. After 2008, the decline of the citation advantage subsided and became relatively stable, which suggests that incorporating foreign language literature continues to increase scientific impact, even as the scientific community itself becomes increasingly international. However, internationalization is not without concerns: the work closes with a discussion of the benefits and potential problems of the lack of linguistic diversity in scientific communication.
A Quantitative Exploration on Reasons for Citing Articles from the Perspective of Cited Authors

Binglu Wang,Yi Bu,Yang Xu

DOI: https://doi.org/10.1007/s11192-018-2787-6

IF: 3.801

2018-01-01

Scientometrics

Abstract:Citation is regarded as one of the “norms of science” (Merton in Am Sociol Rev 22(6):635–659, 1957) and is deeply researched by the field of scientometrics. The motivations authors have for citing one another are considered significant and have been the subject of extensive qualitative research such as content analysis, questionnaires, and interviews of citing authors. However, the existing qualitative studies have covered a limited number of samples. To expand the dataset, this paper proposes a quantitative method applied to detecting citation reasons from the angle of citation networks and the attributes of cited authors, including their publication count (the number of single-authored publications, collaborative and first-authored publications as well as collaborative but non-first-authored publications, and number of whole publications), citation count, research topic interests, and gender. By applying the Exponential Random Graph Models (ERGMs), the current study revealed that authors in the field of information retrieval tend to cite those with more single-authored, collaborative and first-authored, and collaborative but not first-authored publications. Besides, in this field, the number of publications, similar topical domains, and same gender are proven to be significantly favorable in selecting references in our experiment.

Citing is earlier than Cited?

Patent Citations to Scientific Papers As Early Signs for Predicting Delayed Recognition of Scientific Discoveries: a Comparative Study with Instant Recognition.

The Time Dimension of Science: Connecting the Past to the Future

From Zero to One: A Perspective on Citing.

A Comparative Study of Domestic and Cross‐country Impact of Chinese and U.S. Publications in Chemistry

A Primary Study on Negative Citation in Citation Data

The relationship between interdisciplinarity and citation impact-a novel perspective on citation accumulation

Contradistinctive Analyses on Cited Delays of Chinese SCI Articles

Editorial Delay and Its Relation to Subsequent Citations: the Journals Nature , Science and Cell

Openness and Knowledge Sharing of Economics,Sociology,Law and Politics:A Comparative Study on Citations of Chinese Social Science Journals

Citing for High Impact

The Role of Positive and Negative Citations in Scientific Evaluation

Research on the Phenomenon of Articles'Delayed Citation

Forgotten Knowledge: Examining the Citational Amnesia in NLP

Are self-citations a normal feature of knowledge accumulation?

Paper-Patent Citation Linkages as Early Signs for Predicting Delayed Recognized Knowledge: Macro and Micro Evidence

Is there really a Citation Age Bias in NLP?

Delayed Citation Impact of Interdisciplinary Research

Hidden Citations Obscure True Impact in Science

The citation advantage of foreign language references for Chinese social science papers

A Quantitative Exploration on Reasons for Citing Articles from the Perspective of Cited Authors