Illusion of Increased Research Quality? A Clubbing Effect Analysis of China's Research

Li Tang

DOI: https://doi.org/10.5465/ambpp.2014.10810abstract

2014-01-01

Abstract:There is increasing evidence that citations to Chinese research are rising sharply. A variety of explanations have been explored in previous studies. This research aims to explore another potential explanation ¨C whether there exists a

What problem does this paper attempt to address?

Is There A Clubbing Effect Underlying Chinese Research Citation Increases?

Li Tang,Philip Shapira,Jan Youtie

DOI: https://doi.org/10.1002/asi.23302

2015-01-01

Journal of the Association for Information Science and Technology

Abstract:There is increasing evidence that citations to Chinese research publications are rising sharply. A series of reasons have been highlighted in previous studies. This research explores another possibilitywhether there is a clubbing effect in China's surge in research citations, in which a higher rate of internal citing takes place among influential Chinese researchers. Focusing on the most highly cited research articles in nanotechnology, we find that a larger proportion of Chinese nanotechnology research citations are localized within individual, institutional, and national networks within China. Both descriptive and statistical tests suggest that highly cited Chinese papers are more likely than similar U.S. papers to receive internal and localized citations. Tentative explanations and policy implications are discussed.
Openness and Knowledge Sharing of Economics,Sociology,Law and Politics:A Comparative Study on Citations of Chinese Social Science Journals

Shi Jinchuan,Zhang Yuhao

DOI: https://doi.org/10.3785/j.issn.1008-942X.2011.08.171

2012-01-01

Abstract:As an important part of academic papers which comply with the norms of social science research,citations themselves are of great research value.On the basis of the collection of citation data from top Chinese journals in economics,sociology,law and politics and on the basis of internal and international comparison research,we find that economics and sociology are more open to research abroad while law and politics are less open.And in these subjects,the level of citations to other social sciences is comparatively low.We also find that the percentage of self-citation in economics decreased significantly while that in sociology,law and politics increased moderately between 1998 and 2008 according to the results of the comparison of interdisciplinary citations.On the other hand,the percentage of interdisciplinary citation of sociology and law to economics are quite high,while the percentage of interdisciplinary citation of politics to economics is low.We think that the lack of interdisciplinary journals and the lack of researchers are two key reasons for the underdevelopment of interdisciplinary research in China.
A Comparative Study of Domestic and Cross‐country Impact of Chinese and U.S. Publications in Chemistry

Xiaojing Cai,Xiaozan Lyu,Ping Zhou

DOI: https://doi.org/10.1002/pra2.5

2019-01-01

Abstract:ABSTRACTBased on publications in Chemistry in 2015, this paper investigated the citation impact on domestic and foreign scholarly communities of Chinese and US publications, and to what extent does such impact relate to international collaboration and government funding. First‐ or corresponding authorship in international collaboration is defined as dominance and is taken into consideration. Citations to publications are designated as domestic citations (Chinese or US citations), partner citations or other citations according to overlap of countries of citing and cited publications. Significant difference exists in the two countries. Most citations of Chinese publications are from domestic and partner countries, with domestic citations being the mainstay. In contrast, US papers receive more other citations than domestic or partner citations, and citations from partner countries contribute significantly. US papers have higher global impact than those of China. High domestic citation propensity is associated with non‐international collaboration, dominance of focal country in international collaboration, and national funding support. Such phenomenon is more pronounced in Chinese papers. In other words, citation impact of Chinese publications is more limited in domestic community, whereas that of the US is more global.
Characteristics of Research in China Assessed with Essential Science Indicators

Hui-Zhen Fu,Kun-Yang Chuang,Ming-Huang Wang,Yuh-Shan Ho

DOI: https://doi.org/10.1007/s11192-011-0416-8

IF: 3.801

2011-01-01

Scientometrics

Abstract:To provide an overview of the characteristics of research in China, a bibliometric evaluation of highly cited papers with high-level representation was conducted during the period from 1999 to 2009 based on the Essential Science Indicators (ESI) database. A comprehensive assessment covered overall performance, journals, subject categories, internationally collaborative countries, national inter-institutionally collaborative institutions, and most-cited papers in 22 scientific fields. China saw a strong growth in scientific publications in the last decade, to some extent due to increasing research and development expenditure. China has been more active in ESI fields of chemistry and physics, but more excellent in materials science, engineering and mathematics. Most publications were concerned with the common Science Citation Index subject categories of multidisciplinary chemistry, multidisciplinary materials and science, and physical chemistry. About one half China's ESC papers were internationally collaborative and the eight major industrialized countries (the USA, Germany, the UK, Japan, France, Canada, Russia, and Italy) played a prominent role in scientific collaboration with China, especially the USA. The Chinese Academy of Sciences took the leading position of institutions with many branches. The "985 Project" stimulated the most productive institutions for academic research with a huge funding injection and the universities in Hong Kong showed good scientific performance. The citation impact of internationally collaborative papers differed among fields and international collaborations made positive contributions to academic research in China.
China's global growth in social science research: Uncovering evidence from bibliometric analyses of SSCI publications (1978–2013)

Weishu Liu,Guangyuan Hu,Li Tang,Yuandi Wang

DOI: https://doi.org/10.1016/j.joi.2015.05.007

IF: 3.7

2015-07-01

Journal of Informetrics

Abstract:The phenomenon of China's rise as an emerging scientific power has been well documented, yet the development of its social science is less explored. Utilizing up-to-date Social Science Citation Index (SSCI) publication data (1978–2013), this paper probes the patterns and dynamics of China's social science research via bibliometric analyses. Our research indicates that despite the national orientation of social science research and the linguistic obstacle of publishing for an international audience, China's publications in the SSCI dataset have been rising in terms of volume, world share, and global ranking. But China is still not yet a major player in the arena of social sciences, as is evidenced by the number of Chinese journals indexed in SSCI and the lack of Olympic players. Team research features China's international publishing in social science, but the research outputs are highly unbalanced at regional and institutional levels.

information science & library science,computer science, interdisciplinary applications
Telling Our Own Story: A Bibliometrics Analysis of Mainland China’s Influence on Chinese Politics Research, 2001–2020

Hui-Zhen Fu,Li Shao

DOI: https://doi.org/10.1017/s1049096522001147

2023-01-01

Abstract:ABSTRACTThis study conducted a bibliometric analysis of Chinese politics research from 2001 to 2020 (N = 11,285) using Social Sciences Citation Index data. The number of publications in the field by scholars from Mainland China surged in the past 20 years; however, their influence on academia remained limited. Chinese institutions serve as the major hubs of collaborative networks. Using structural topic models, we identified 25 research topics that can be categorized in three clusters. In the past 20 years, scholars from Mainland China steered the focus of Chinese politics by causing a reduction in the proportion of international relation topics and an increase in the proportion of political economy topics. Domestic politics topics had the most citations. Scholars from Mainland China have made contributions to better research methods in the field. This article is a comprehensive view of Chinese politics research using a tool that is rarely used by political scientists. It depicts how studies of Chinese politics influence academia from a bibliometrics perspective.
Independent research of China in Science Citation Index Expanded during 1980–2011

Hui-Zhen Fu,Yuh-Shan Ho

DOI: https://doi.org/10.1016/j.joi.2012.11.005

IF: 3.7

2013-01-01

Journal of Informetrics

Abstract:The study explores the characteristics of China's independent research articles published from 1980 to 2011, based on the database of Science Citation Index Expanded. The publication outputs of seven major industrialized countries including Canada, France, Japan, Germany, Italy, the UK, and the USA were compared with China. Annual production, field performance, research emphases and trends, top articles, as well as main institutional and individual contributors by its top cited articles were analyzed. Some newly developed indicators related to words in title, author keywords, KeyWords Plus, first author, corresponding author, and Y-index were employed to provide in-depth information on topic and author contributions. Results showed that China has been closing the gap with the USA with the greatest growth, and has stood the second since 2006. Most top cited articles were published in 2000s, made up approximately seven tenths of total articles. Pronounced activities were found in chemistry and physics related categories. The core categories included multidisciplinary chemistry, physical chemistry, multidisciplinary materials science, and applied physics. Moreover, China's performance of nanotechnology and science, especially carbon nanotubes, nanoparticles, nanowires, and nanostructures showed dramatic growth. Six top articles with at least 1000 citations were examined, and were observed to concern medicine, nanotube, and adsorption. In addition, main contributing institutions and authors were also revealed and evaluated. Chinese Academy of Sciences played a dominant role, and Tsinghua University, Peking University and five universities in Hong Kong showed good scientific performance.
The output of Chinese international articles and its influence mechanism:1987 - 2007

LIU Ziyu,SHEN Wenqin

2011-01-01

Abstract:As the reform and opening-up in China were deep-going,the enrichment of China's academic research activities,the proliferation of China's research groups,the increase of China'ss scientific outcomes,and the growth of China'ss international impact were getting more and more attention of both domestic and foreign scholars.With the help of ISI citation database and China's statistical data,this paper described the progress of China'ss international research papers after the reform and opening-up,while analyzed influence of different factors,such as R&D Investments,population of researchers,and culture and policy,finally putting forward relevant policy suggestions.
The relationship between interdisciplinarity and citation impact-a novel perspective on citation accumulation

Xiaojing Cai,Xiaozan Lyu,Ping Zhou

DOI: https://doi.org/10.1057/s41599-023-02475-3

2023-01-01

Abstract:Interdisciplinary research is of significance for creating breakthroughs and facilitating innovations and may achieve higher citation impact, although contrary results still exist. The current study looks into the relationship between interdisciplinarity and citation impact from a brand-new perspective-the process of citation accumulation-by exploring how interdisciplinarity, as measured by Rao-Stirling and DIV, affects the accumulating process of citations, based on scientific papers published by Chinese or US authors in 2009-2011 in Chemistry. Two metrics are used to measure how long it takes for a paper to reach its citation peak (PEAK_YEAR) and how sustainable the citation impact remains after the peak (SUS). The results show that compared with Rao-Stirling, DIV is more sensitive to the length of the citation window and more closely aligned with the nature of interdisciplinarity. In Chemistry, higher interdisciplinarity is more likely to encounter delayed recognition and greater citation sustainability, which may explain the inconsistency in the relationship between interdisciplinarity and citation impact. In conclusion, it is necessary to consider the length of the citation window when explaining the relationship between interdisciplinarity and citation impact. A longer citation window may be a better solution, as an alternative or supplement, in assessing the academic performance of interdisciplinary research.
Big Fishes in a Big Pond: A Comparison Between Foreign and Chinese Academics’ Research Influence in Mainland China

Giulio Marini,Xin Xu

DOI: https://doi.org/10.1177/2212585x221145244

2023-01-01

International Journal of Chinese Education

Abstract:This article investigates the research influence (as indicated by citations and the SCImago quartile classification of target journal of publication) as per Global Western standards of foreign and Chinese academics in mainland China. The focus on research influence echoes the policy shifts in Chinese research from quantity to quality. This study analyses Scopus publications by foreign academics working in 15 research-intensive Chinese universities, comparing them with publications by Chinese colleagues in the same meso-institutional level (departments, schools, institutes) with same sex and academic rank, but with a doctoral degree attained in China. Findings show that foreign academics’ publications attract more citations, and, once checking by covariates, they are also more likely to publish in first quartile Scimago journals. Chinese academics’ publications, in comparison, tend to be in journals with higher Scimago quartile ranks on average. The study also reveals that foreign academics have more international co-authorships than their Chinese counterparts, despite this latter point being not necessarily conducive of more influent research.
A 'home bias' in citations boosts China's global science ranking

Dennis Normile

DOI: https://doi.org/10.1126/science.adt5690

IF: 56.9

2024-10-05

Science

Abstract:Studies find a majority of citations to top-ranked papers produced in China come from within the nation itself

multidisciplinary sciences
Feature Report on China: A Bibliometric Analysis of China-Related Articles

Weishu Liu,Li Tang,Mengdi Gu,Guangyuan Hu

DOI: https://doi.org/10.1007/s11192-014-1371-y

IF: 3.801

2014-01-01

Scientometrics

Abstract:China's rise in science has been widely acknowledged. Yet we know little empirically about academic research focusing on China. Utilizing a uniquely constructed large-scale dataset, this paper explores China-related publications through bibliometric analysis. Our data suggests that not only interest in China but also knowledge about China has developed rapidly over the years. Despite an increasingly diverse profile of participants, the substantial rise of research focusing on China is largely limited to affluent regions and some geographically proximate neighbors of China. The research discloses that overseas Chinese facilitate academic research focusing on China. The research foci of China-related studies have gradually shifted from social science to natural science and, in more recent years, to Chinese environmental issues, public health and economy.
The structure and comparative advantages of China’s scientific research: quantitative and qualitative perspectives

Lili Wang

DOI: https://doi.org/10.1007/s11192-015-1650-2

IF: 3.801

2015-08-13

Scientometrics

Abstract:In recent decades China has witnessed an impressive improvement in science and its scientific output has become the second largest in the world. From both quantitative and qualitative perspectives, this paper aims to explore China’s comparative advantages in different academic disciplines. This paper employs two datasets: publications in all journals and publications in the top 5 % journals by discipline. With the former database we investigate the comparative advantages of each academic discipline in terms of absolute output volume, and with the latter database we evaluate the scientific output published in prestigious resources. Different from the criticism stated in previous literature, this paper finds that the quality of China’s research (represented by papers published in high-impact journals) is promising. Since 2006 the growth of scientific publications in China has been driven by papers published in English-language journals. The increasing visibility of Chinese science seems to be paving the way for its wider recognition and higher citation rates.

information science & library science,computer science, interdisciplinary applications
China's SCI-indexed publications: facts, feelings, and future directions

Weishu Liu

DOI: https://doi.org/10.48550/arXiv.2005.10537

2020-05-21

Digital Libraries

Abstract:Purpose:In relation to the boom in China's SCI-indexed publications, this opinion piece examines this phenomenon and looks at future possible directions for the reform of China's research evaluation processes. Design/Approach/Methods:This opinion piece uses bibliographic data for the past decade (2010-2019) from the Science Citation Index Expanded in the Web of Science Core Collection to examine the rise in China's SCI-indexed publications. Findings: China has surpassed the United States and been the largest contributor of SCI publications since 2018. However, while the impact of China's SCI publications is rising, the scale of this impact still lags behind that of other major contributing countries. China's SCI publications are also overrepresented in some journals. Originality/Value: Reporting the latest facts about China's SCI-indexed publications, this article will benefit the reform of China's research evaluation system.
Higher education expansion and the rise of China in economics research

Matloob Piracha,Massimiliano Tani,Klaus F. Zimmermann,Yu Zhang

DOI: https://doi.org/10.1016/j.chieco.2022.101813

IF: 4.744

2022-08-01

China Economic Review

Abstract:China has seen a massive higher education expansion, which the literature has dated to the 1999–2008 period with quantitative and qualitative outcomes. However, the consequences for the publication success of Chinese authors worldwide are not well studied. We review the respective Chinese higher education policies and document the dramatic rise in publication success, with a focus on the field of Economics. A substantial set of regressions and robustness checks confirm the understanding that the higher education expansion has indeed let to a substantial worldwide rise in scientific publications in refereed economics journals fueled by the general incentives of the reform, through research collaborations and other quality improving factors.

economics
A discussion of measuring the top-1 percent most-highly cited publications: Quality and impact of Chinese papers

Caroline S. Wagner,Lin Zhang,Loet Leydesdorff

DOI: https://doi.org/10.48550/arXiv.2202.00781

2022-02-02

Abstract:The top 1 percent most highly cited articles are watched closely as the vanguards of the sciences. Using Web of Science data, one can find that China had overtaken the USA in the relative participation in the top 1 percent in 2019, after outcompeting the EU on this indicator in 2015. However, this finding contrasts with repeated reports of Western agencies that the quality of Chinese output in science is lagging other advanced nations, even as it has caught up in numbers of articles. The difference between the results presented here and the previous results depends mainly upon field normalizations, which classify source journals by discipline. Average citation rates of these subsets are commonly used as a baseline so that one can compare among disciplines. However, the expected value of the top 1 percent of a sample of N papers is N 100, ceteris paribus. Using the average citation rates as expected values, errors are introduced by using the mean of highly skewed distributions and a specious precision in the delineations of the subsets. Classifications can be used for the decomposition, but not for the normalization. When the data is thus decomposed, the USA ranks ahead of China in biomedical fields such as virology. Although the number of papers is smaller, China outperforms the US in the field of Business and Finance in the Social Sciences Citation Index when p is less than .05. Using percentile ranks, subsets other than indexing based classifications can be tested for the statistical significance of differences among them.

Digital Libraries,Applications
The citation advantage of foreign language references for Chinese social science papers

Kaile Gong,Juan Xie,Ying Cheng,Vincent Larivière,Cassidy R. Sugimoto

DOI: https://doi.org/10.48550/arXiv.1908.07576

2019-08-20

Digital Libraries

Abstract:Contemporary scientific exchanges are international, yet language continues to be a persistent barrier to scientific communication, particularly for non-native English-speaking scholars. Since the ability to absorb knowledge has a strong impact on how researchers create new scientific knowledge, a comprehensive access to and understanding of both domestic and international scientific publications is essential for scientific performance. This study explores the effect of absorbed knowledge on research impact by analyzing the relationship between the language diversity of cited references and the number of citations received by the citing paper. Chinese social sciences are taken as the research object, and the data, 950,302 papers published between 1998 and 2013 with 8,151,327 cited references, were collected from the Chinese Social Sciences Citation Index. Results show that there is a stark increase in the consumption of foreign language material within the Chinese social science community, and English material accounts for the vast majority of this consumption. Papers with foreign language references receive significantly more citations than those without, and the citation advantage of these internationalized work holds when we control for characteristics of the citing papers. However, the citation advantage has decreased from 1998 to 2008, largely as an artifact of the increased number of papers citing foreign language material. After 2008, the decline of the citation advantage subsided and became relatively stable, which suggests that incorporating foreign language literature continues to increase scientific impact, even as the scientific community itself becomes increasingly international. However, internationalization is not without concerns: the work closes with a discussion of the benefits and potential problems of the lack of linguistic diversity in scientific communication.
Networks of Research Collaboration in China: Evidence from Nanotechnology Publication Activities, 1990-2006

Li Tang,Philip Shapira

DOI: https://doi.org/10.1109/acstip.2007.4472876

2007-01-01

Abstract:The article shows there has been exponential growth overall in nano publication in China, there has been only linear growth in international publication collaboration. Potential explanations for this include increased internal incentives for publication in China in WoS-listed journals and for Chinese researchers to return home. However, there are quality differences between articles by author and collaboration type. Statistical testing indicates that internationally collaborated articles, articles by scholars in Chinese Academy of Science or top 10 Chinese universities, and articles involved Hong Kong scholars are more likely published in journals with high impact factors (IF), and receive high citations. These findings help to highlight China's emerging strengths in nanotechnology and the role of network relations in underpinning these developments.
Can Twitter increase the visibility of Chinese publications?

Fei Shu,Wen Lou,Stefanie Haustein

DOI: https://doi.org/10.1007/s11192-018-2732-8

IF: 3.801

2018-04-06

Scientometrics

Abstract:The purpose of this study is to investigate whether diffusion through social media can help to improve the international visibility of Chinese papers and thus increase their citation impact. After analysing 160,233 Chinese papers published in 2012, as well as the number of tweets and citations received, the results indicate that tweeted Chinese papers published in the same year and journal received around 15% more citations than Chinese papers not mentioned on Twitter. The citation advantage of tweeted Chinese papers is also found within various disciplines and by the different citing countries.

information science & library science,computer science, interdisciplinary applications
A Discussion of Measuring the Top-1% Most-Highly Cited Publications: Quality and Impact of Chinese Papers.

Wagner Caroline S.,Zhang Lin,Leydesdorff Loet

DOI: https://doi.org/10.1007/s11192-022-04291-z

IF: 3.801

2022-01-01

Scientometrics

Abstract:The top-1% most-highly-cited articles are watched closely as the vanguards of the sciences. Using Web of Science data, one can find that China had overtaken the USA in the relative participation in the top-1% (PP-top1%) in 2019, after outcompeting the EU on this indicator in 2015. However, this finding contrasts with repeated reports of Western agencies that the quality of China’s output in science is lagging other advanced nations, even as it has caught up in numbers of articles. The difference between the results presented here and the previous results depends mainly upon field normalizations, which classify source journals by discipline. Average citation rates of these subsets are commonly used as a baseline so that one can compare among disciplines. However, the expected value of the top-1% of a sample of N papers is N / 100, ceteris paribus. Using the average citation rates as expected values, errors are introduced by (1) using the mean of highly skewed distributions and (2) a specious precision in the delineations of the subsets. Classifications can be used for the decomposition, but not for the normalization. When the data is thus decomposed, the USA ranks ahead of China in biomedical fields such as virology. Although the number of papers is smaller, China outperforms the US in the field of Business and Finance (in the Social Sciences Citation Index; p < .05). Using percentile ranks, subsets other than indexing-based classifications can be tested for the statistical significance of differences among them.

Illusion of Increased Research Quality? A Clubbing Effect Analysis of China's Research

Is There A Clubbing Effect Underlying Chinese Research Citation Increases?

Openness and Knowledge Sharing of Economics,Sociology,Law and Politics:A Comparative Study on Citations of Chinese Social Science Journals

A Comparative Study of Domestic and Cross‐country Impact of Chinese and U.S. Publications in Chemistry

Characteristics of Research in China Assessed with Essential Science Indicators

China's global growth in social science research: Uncovering evidence from bibliometric analyses of SSCI publications (1978–2013)

Telling Our Own Story: A Bibliometrics Analysis of Mainland China’s Influence on Chinese Politics Research, 2001–2020

Independent research of China in Science Citation Index Expanded during 1980–2011

The output of Chinese international articles and its influence mechanism:1987 - 2007

The relationship between interdisciplinarity and citation impact-a novel perspective on citation accumulation

Big Fishes in a Big Pond: A Comparison Between Foreign and Chinese Academics’ Research Influence in Mainland China

A 'home bias' in citations boosts China's global science ranking

Feature Report on China: A Bibliometric Analysis of China-Related Articles

The structure and comparative advantages of China’s scientific research: quantitative and qualitative perspectives

China's SCI-indexed publications: facts, feelings, and future directions

Higher education expansion and the rise of China in economics research

A discussion of measuring the top-1 percent most-highly cited publications: Quality and impact of Chinese papers

The citation advantage of foreign language references for Chinese social science papers

Networks of Research Collaboration in China: Evidence from Nanotechnology Publication Activities, 1990-2006

Can Twitter increase the visibility of Chinese publications?

A Discussion of Measuring the Top-1% Most-Highly Cited Publications: Quality and Impact of Chinese Papers.