The Deficiencies and Complementarities on the Journal Citation

Cai-li WU,Qi-gui SUN

DOI: https://doi.org/10.3969/j.issn.1673-162X.2007.03.018

2007-01-01

Abstract:The journal citation studies partly have not taken the quality and influence into account.The paper analyses the factors and probes the internal relationship between quality and influence and gives means to the problems of deficiencies in quality and influence,and suggests solutions to them.

What problem does this paper attempt to address?

Recovering uncaptured citations in a scholarly network: A two-step citation analysis to estimate publication importance

zhuoren jiang,xiaozhong liu,yan chen

DOI: https://doi.org/10.1002/asi.23475

2016-01-01

Abstract:AbstractThe citation relationships between publications, which are significant for assessing the importance of scholarly components within a network, have been used for various scientific applications. Missing citation metadata in scholarly databases, however, create problems for classical citation-based ranking algorithms and challenge the performance of citation-based retrieval systems. In this research, we utilize a two-step citation analysis method to investigate the importance of publications for which citation information is partially missing. First, we calculate the importance of the author and then use his importance to estimate the publication importance for some selected articles. To evaluate this method, we designed a simulation experiment-"random citation-missing"-to test the two-step citation analysis that we carried out with the Association for Computing Machinery ACM Digital Library DL. In this experiment, we simulated different scenarios in a large-scale scientific digital library, from high-quality citation data, to very poor quality data, The results show that a two-step citation analysis can effectively uncover the importance of publications in different situations. More importantly, we found that the optimized impact from the importance of an author first step is exponentially increased when the quality of citation decreases. The findings from this study can further enhance citation-based publication-ranking algorithms for real-world applications.
Analysis of the Validity of Journal Citation Identities and Journal Citation Images

Zheng Dejun,Ye Jiyuan

DOI: https://doi.org/10.13530/j.cnki.jlis.2010.04.015

2010-01-01

Abstract:Although the journal evaluation index system featuring the adoption of citation data such as journal impact factor as its core is widely used,this system has long been the center of controversy.This paper analyzes the new method of journal evaluation from journal citation identities,journal citation images and the internationalization of journals,and discusses the validity of related indicators.Analysis found that many indexes of the first two categories of indicators can be confirmed by the impact factor.As a result,journal citation identity indicators and journal citation image indicators can be employed as a new method in Chinese journal evaluation.Furthermore,indexes concerning journal internationalization should be further verified.
A Quantitative Evaluation System of Chinese Journals in the Humanities and Social Sciences

SU Xinning,ZHOU Ping

2009-01-01

Abstract:Based on analyses on existing indicators for evaluating journals in the humanities and social sciences and our experience in constructing the Chinese Social Science Citation Index（CSSCI）,we proposed a comprehensive system for evaluating Chinese academic journals in the humanities and social sciences.This system constitutes 8 primary indicators and 17 sub-indicators for multidisciplinary journals and 19 sub-indicators for discipline-specific journals.Each indicator or sub-indicator is assigned a suitable weight according to its importance in terms of measuring a journal’s academic quality and/or impact.
The Impact of Internet Resources on Scholarly Communication: A Citation Analysis.

Chuanfu Chen,Kai Sun,Gang Wu,Qiong Tang,Jian Qin,Kuei Chiu,Yushuang Fu,Xiaofang Wang,Jing Liu

DOI: https://doi.org/10.1007/s11192-008-2180-y

IF: 3.801

2009-01-01

Scientometrics

Abstract:The quality and credibility of Internet resources has been a concern in scholarly communication. This paper reports a quantitative analysis of the use of Internet resources in journal articles and addresses the concerns for the use of Internet resources scholarly journals articles. We collected the references listed in 35,698 articles from 14 journals published during 1996 to 2005, which resulted in 1,000,724 citations. The citation data was divided into two groups: traditional citations and Web citations, and examined based on frequencies of occurrences by domain and type of Web citation sources. The findings included: (1) The number of Web citations in the journals investigated had been increasing steadily, though the quantity was too small to draw an inclusive conclusion on the data about their impact on scientific research; (2) A great disparity existed among different disciplines in terms of using information on the Web. Applied disciplines and interdisciplinary sciences tended to cite more information on the Web, while classical and experimental disciplines cited little of Web information; (3) The frequency of citations was related to the reputation of the author or the institution issuing the information, and not to the domain or webpage types; and (4) The researchers seemed to lack confidence in Internet resources, and Web information was not as frequently cited as reported in some publications before. The paper also discusses the need for developing a guideline system to evaluate Web resources regarding their authority and quality that lies in the core of credibility of Web information.
Several Problems in Assessing Quality of Biomedical Papers

DONG Yanping,LEI Shuiying,WANG Panzhi,QIAN Shouchu

DOI: https://doi.org/10.16811/j.cnki.1001-4314.2009.03.010

2009-01-01

Abstract:The conventional models of quality assessment of biomedical papers and information exchange have greatly changed in the last few years.Peer review system has its weakness in medical journal publishing but has not changed much worldwide.The use of citation analysis and impact factor in assessment of research papers is out the correct track.Open access in combination with traditional peer review system seems to be feasible in evaluating biomedical research papers,and in some sense it is open,fair and justice.
Factors, Components and Dynamics: Investigation of Journal Self-Citation and Citation by Equal Opportunity Model

Yangping Zhou

DOI: https://doi.org/10.1016/j.heliyon.2022.e10292

IF: 3.776

2022-01-01

Heliyon

Abstract:The effectivity of journal impact factor (JIF) is questioned in evaluating academic players. Coercive self-citation was widely criticized and Clarivate annually suppressed journals with high journal self-citation (JSC) rates. Recently, some journals significantly increased their articles but their JIFs and JSC rates were diversified which lacks reasonable explanations. Here, we revealed the complexities of the dynamical interactions among different influence factors and different components of journal citation. Journal citation frequencies have strong correlations with JSC rates regarding citable items, significant correlations with numbers of journals' articles and negative significant correlations with JSC rates regarding total citations. Journal citation consists of JSC, intradisciplinary non-JSC and interdisciplinary non-JSC. JSC has the quickest dynamic and interdisciplinary non-JSC has the slowest dynamic while most journals are more cited by interdisciplinary citations. Journal citation is initially decided by the number of citable items. Journal's share (citing articles) in related disciplines influence JSC and intradisciplinary non-JSC positively and negatively, respectively. Multiple citations promoted by the increase in articles, the skewness of the topic profile, preference-related self-citation and anomalous self-citation are of benefit to citation. The complex dynamical interactions result in increment effects of the number of articles acting on JIF, which is stronger for JSC and citable items. The increase in articles also promotes intradisciplinary non-JSC when the journal's shares in related disciplines are low. This process will be reversed after the journal's shares become high enough which may finally decrease its impact factor. It is quicker for the journal with a stronger intradisciplinary citation. The calculational results of the average JIFs of selected journals agree with the statistical results. In addition, we can explain the related situations of some journals. Finally, we suggested that the JSC rate in terms of citable items should be considered for judging the level of JSC.
Study on Web Influence of CSSCI Source Journals

LIU Hong,SUN Jianjun,ZHENG Yanning,PAN Yuntao

DOI: https://doi.org/10.3969/j.issn.1002-1965.2012.04.002

IF: 3.1759

2012-01-01

Journal of Intelligence

Abstract:Taking CSSCI source journals as data source,we get link indexes of relevant sites with Yahoo! Site Explorer and calculate correlation of journal ranking and the link indexes.Furthermore,we build the link index system of journal network evaluation,providing some guidance and suggestions to improve and optimize journal websites.
International Performance of Chinese Institutes in Different Disciplines——A Bibliometric View

ZHONG Yongfeng,ZHOU Ping

DOI: https://doi.org/10.3969/j.issn.1002-1965.2012.04.015

IF: 3.1759

2012-01-01

Journal of Intelligence

Abstract:With the development of scientific research,effective evaluation of institutes' achievements becomes one of the great challenges that decision makers face.Based on the analysis of SCImago Institutions Rankings World Report 2010 in health sciences,life sciences,physical sciences and social sciences humanities,the status of Chinese institutes in the world are discussed by analyzing various indicators like output,international collaboration,high quality publications,normalized impact and the correlations between them.Chinese institutes perform quiet well in output but still not catch up that of the America.In terms of international collaboration,they are much less active than the European countries,which attach great importance to global cooperation.In addition,there are still great difference between China and leading countries in other two indicators of high quality publications and normalized impact.Therefore with keeping the high quantity of papers,Chinese institutes should also aim to improve their quality by making stronger international links and encouraging scientific researchers to submit their papers to high quality academic journals,so as to strengthen the communication with prominent author group.
Analysis of the Deficiencies in Current Academic Evaluation Mechanism in China

Yang Jianlin

DOI: https://doi.org/10.16353/j.cnki.1000-7490.2012.06.013

2012-01-01

Abstract:Based on the analysis of the current research,this paper summarizes the Chinese scholars' views on the problems in the current academic evaluation mechanism and their measures for improvement.The paper analyzes the deficiencies in the current academic evaluation mechanism in China systematically and in depth from the following 5 aspects: mechanism of declaring and submitting material,mechanism of examining and selecting experts,mechanism of scientific evaluation modes,mechanism of evaluation socialization and mechanism of supervision and announcement.
The Role of Positive and Negative Citations in Scientific Evaluation

Xiaomei Bai,Ivan Lee,Zhaolong Ning,Amr Tolba,Feng Xia

DOI: https://doi.org/10.48550/arXiv.2008.03844

2020-08-10

Abstract:Quantifying the impact of scientific papers objectively is crucial for research output assessment, which subsequently affects institution and country rankings, research funding allocations, academic recruitment and national/international scientific priorities. While most of the assessment schemes based on publication citations may potentially be manipulated through negative citations, in this study, we explore Conflict of Interest (COI) relationships and discover negative citations and subsequently weaken the associated citation strength. PANDORA (Positive And Negative COI- Distinguished Objective Rank Algorithm) has been developed, which captures the positive and negative COI, together with the positive and negative suspected COI relationships. In order to alleviate the influence caused by negative COI relationship, collaboration times, collaboration time span, citation times and citation time span are employed to determine the citing strength; while for positive COI relationship, we regard it as normal citation relationship. Furthermore, we calculate the impact of scholarly papers by PageRank and HITS algorithms, based on a credit allocation algorithm which is utilized to assess the impact of institutions fairly and objectively. Experiments are conducted on the publication dataset from American Physical Society (APS) dataset, and the results demonstrate that our method significantly outperforms the current solutions in Recommendation Intensity of list R at top-K and Spearman's rank correlation coefficient at top-K.

Digital Libraries,Information Retrieval
Quality and Innovativeness in the Evaluation of Academic Journals

Ye Jiyuan

DOI: https://doi.org/10.3785/j.issn.1008-942X.2013.01.221

2013-01-01

Abstract:Academic journal is an important medium of research publication and academic exchange.The academic journal evaluation system in China has been initially established,but quality and innovativeness evaluations are still weak.There are profound socio-economic,cultural,administrative reasons for this problem,which have caused negative impact on the value orientation of scholars and their research behavior,affected the objectivity and impartiality of academic evaluation,and undermined the cleanness and pureness of the academia. Scholars of the humanities and social sciences and library and information science experts have already reached a consensus that academic evaluation in the humanities and social sciences should be more diverse,localized and content-based,and there should be quality and innovativeness evaluations.In the past dozen years,academic journal evaluation is mainly quantitative and formal,but now more emphasis should be placed on content evaluation and innovativeness evaluation to create a fair and free environment for academic journal evaluation. On the premise of maintaining the reasonable elements in the existing academic journal evaluation system,this article proposes a combination of three new concepts including formal evaluation,content evaluation and effectiveness evaluation,and puts forward a new evaluation method integrating peer-review and bibliometric evaluation.The proposed combination of the three new concepts would be able to explain the history and the current situation of journal evaluation,and also predict its future.The aim of the new thinking and the approach to realize it is to overcome the institutional obstacles that hinder the healthy development of academic evaluation,to establish a fair and rational academic environment for scholars,and to create an open and constructive academic environment in the future.
International Competitiveness Of Chinese Journals

Rongying Zhao,Ruixian Yang,Ke Dong,Qing Fang

2008-01-01

Abstract:Academic journals are the gatekeepers of new scientific breakthroughs and discoveries, reflecting and validating the scientific progress of research endeavors of educational institutions and corporate investigations. As China continues development as a world leader in many arenas, it is vital that educational and research progress does not lag behind. An analysis of the stature with which Chinese academic journals are held in the global academic community is one way to validate if the development of Chinese scientific technology is matching pace with the expectations of such development. The main purpose of this study was to analyze the Chinese academic journals which were indexed in Journal Citation Reports (JCR) from 2001 to 2005. In terms of subject distribution; Total Cites, Impact Factor, Immediacy Index, Articles, this paper studied the international competitiveness of these journals. During the five-year period, Chinese academic journals developed swiftly, but problems still exist.
On the Applicability of Journal Citation Identity Indicators in the Evaluation of Journal Impact

Su Fangli,Sun Jianjun

DOI: https://doi.org/10.3969/j.issn.1001-8867.2012.01.013

2012-01-01

Abstract:This paper analyses journal citation identity based on data from 18 LIS journals included in CSSCI in 2009.The results showed that Journal Citation Identity indicators including Reference Count,Reference Count per Article,Percentage of English References,Self-citing Rate,Extensiveness of References,Citing Half Life,Journal Concentration Factor,and Average JIF of Citation Identities,are not significantly correlated to the evaluation of journal impact.This paper argues that Journal Citation Identity indicators can reveal the content features of journal articles,editors' preferences of research topics,and even the development trends of the LIS field.
Openness and Knowledge Sharing of Economics,Sociology,Law and Politics:A Comparative Study on Citations of Chinese Social Science Journals

Shi Jinchuan,Zhang Yuhao

DOI: https://doi.org/10.3785/j.issn.1008-942X.2011.08.171

2012-01-01

Abstract:As an important part of academic papers which comply with the norms of social science research,citations themselves are of great research value.On the basis of the collection of citation data from top Chinese journals in economics,sociology,law and politics and on the basis of internal and international comparison research,we find that economics and sociology are more open to research abroad while law and politics are less open.And in these subjects,the level of citations to other social sciences is comparatively low.We also find that the percentage of self-citation in economics decreased significantly while that in sociology,law and politics increased moderately between 1998 and 2008 according to the results of the comparison of interdisciplinary citations.On the other hand,the percentage of interdisciplinary citation of sociology and law to economics are quite high,while the percentage of interdisciplinary citation of politics to economics is low.We think that the lack of interdisciplinary journals and the lack of researchers are two key reasons for the underdevelopment of interdisciplinary research in China.
A RevieW of the Research on the Evaluation of International Influence of Academic Achievements in Social Science

Huafeng Li,Qinjian Yuan

DOI: https://doi.org/10.3969/j.issn.1002-1965.201708234

IF: 3.1759

2018-01-01

Journal of Intelligence

Abstract:[Purpose/Significance]Under the new media environment,the review of the studies which have evaluated international influ-ence of academic achievement in social science,can help push ahead with the related research.[Method/process]Therefore,we summa-rize the research literatures in terms of the construction of evaluation index,the correlation of evaluation index,the international influence of scholars and institutions, and the international influence of academic journals.[Result/Conclusion]However, problems do exist with current researches,for example,there are few studies on the application of complex network and Altmetrics,few researches on the interna-tional influence of English social science journals sponsored by China,and few works on Chinese journals cited by foreign journals. This work also illustrates some avenues for future research,for example,scholars can introduce Altmetrics indicators to evaluate international in-fluence from multiple perspectives,or use the complex network theory to study the international citation networks and co-author networks.
Analysis Of Academic Evaluation Indicators Based On Citation Quality

Mingyue Zhang,Jin Shi,Jin Wang,Chang Liu

DOI: https://doi.org/10.3745/JIPS.04.0080

2018-01-01

Journal of Information Processing Systems

Abstract:The academic research performance is often quantitatively measured by means of using citation frequency. The citation frequency-based indicators, such as h-index and impact factor, are commonly used reflecting the citation quality to some extent. However, these frequency-based indicators are usually carried out based on the assumption that all citations are equal. This may lead to biased evaluations in that, the attributes of the citing objects and cited objects are significant. A high-accuracy evaluation method is needed. In this paper, we review various citation quality-based evaluation indicators, and categorize them considering the algorithms being applied. We discuss the pros and cons of these indicators, and compare them from four dimensions. The outcomes will be useful for our further research on distinguishing citation quality.
On the Relation between the Language/Editing Quality of Academic Journals and the Selective Conditions for Core Journals in China

Lu Jianping

DOI: https://doi.org/10.3785/j.issn.1008-942X.2009.05.081

2009-01-01

Abstract:It's apparently scientific that "citation counts" such as "Number of Journals in Category","Number of Articles in Category and Impact Factor"are employed as criterion measures for assessing the impact of core journals.However,a further discussion is called for whether it's reasonable to exclude language/editing quality index from the selective conditions for core journals.The article elaborates the need for improving the selective conditions for core journals in China by explaining the relation between language/editing quality and journal assessment through revealing the result of the project "Language/Editing quality of English abstracts of essays in academic journals published in 2008 in China" assigned by the General Administration of Press and Publication of People's Republic of China,and case-analyses are synchronously provided.
Analysis of Citation Frequency and Citation Extent of Journalism & Communication Academic Journals(2004—2006)

Hu Yuanshuai,Deng Sanhong,Wang Hao

2008-01-01

Abstract:In this paper, based on the data from CSSCI (2004—2006),we evaluated the journalism & communication academic journals objectively by analyzing the citation frequency and citation extent, besides, the j ournalism & communication academic journals were classified according to the citation frequency to guide the de- velopment of academic journals in journalism & communication.
Evaluation of the discourse power in Chinese academic journals: A multi-fusion perspective

Xu Wang

DOI: https://doi.org/10.1016/j.dim.2022.100026

2022-12-01

Data and Information Management

Abstract:Under the environment of open science, the transformation of scientific exchange and research paradigms urgently needs diversified and open scientific evaluation. This study aims to advance the construction of academic journals, reform the quantitative evaluation mechanism, and provide references for promoting the international discourse power of Chinese academic journals. It also aims to enrich and improve the indicator system and evaluation theory of the discourse power of academic journals with Chinese characteristics. Firstly, this paper analyzes the fundamental concerns of the discourse power evaluation of academic journals, drawing on the theory of evaluation science, discourse power theory, and communication theory. According to the characteristics and connotation of the evaluation indicators, the definition and formation process of academic journals' discourse power, this paper constructed. the evaluation indicator system. Secondly, this paper obtained 163,628 international citations and 211,150 domestic citations, and 111,496 altmetrics indicators data for 29,203 published papers from 238 Chinese English-language journals. Meanwhile, 12 scientometrics indicators and 14 altmetrics indicators are selected. Thirdly, descriptive statistical analysis and an overview indexed by international databases are carried out at the macro level. Then, correlation analysis, factor analysis, entropy weight method and TOPSIS method are adopted to evaluate and analyze the discourse influence and discourse leading in Chinese English-language journals by integrating scientometrics and altmetrics indicators. Finally, Two-dimensional and four quadrant method is used to evaluate academic journals' discourse power. At the same time, this paper compares and verifies the reliability of the evaluation results. The findings demonstrate that the research on the academic journals' discourse power evaluation based on the theory, method and application logic is practical, comprehensive and reliable. This paper also puts forward the countermeasures to enhance the discourse power of Chinese academic journals.

English Else
A Comparative Study of the Citation Impact of Chinese Journals with Government Priority Support.

Ping Zhou,Loet Leydesdorff

DOI: https://doi.org/10.3389/frma.2016.00003

2016-01-01

Abstract:In order to improve the citation impact of Chinese journals, relevant Chinese government agencies have launched a program entitled Citation Impact Upgrading Plan (CIUP) with financial support. Only a few journals that perform better have been screened out for CIUP support. The current study tries to figure out if the screening results reflect the bibliometric status of the journals. We compare journals being supported by CIUP with unsupported ones. Journals supported by the CIUP have made progress in raising their JIF values and perform better in terms of JIF values. Journals citing CIUP journals have a spectrum of higher JIF values. Journals in a cited network of a CIUP journal are better integrated with one another. Wide gaps, however, still exist between Chinese and leading international journals. A network visualization of being-cited patterns can be used to measure a journal’s citation impact in relation to the JIF values of journals in the network. Policy suggestions on improving citation impact of Chinese journals will be proposed.

The Deficiencies and Complementarities on the Journal Citation

Recovering uncaptured citations in a scholarly network: A two-step citation analysis to estimate publication importance

Analysis of the Validity of Journal Citation Identities and Journal Citation Images

A Quantitative Evaluation System of Chinese Journals in the Humanities and Social Sciences

The Impact of Internet Resources on Scholarly Communication: A Citation Analysis.

Several Problems in Assessing Quality of Biomedical Papers

Factors, Components and Dynamics: Investigation of Journal Self-Citation and Citation by Equal Opportunity Model

Study on Web Influence of CSSCI Source Journals

International Performance of Chinese Institutes in Different Disciplines——A Bibliometric View

Analysis of the Deficiencies in Current Academic Evaluation Mechanism in China

The Role of Positive and Negative Citations in Scientific Evaluation

Quality and Innovativeness in the Evaluation of Academic Journals

International Competitiveness Of Chinese Journals

On the Applicability of Journal Citation Identity Indicators in the Evaluation of Journal Impact

Openness and Knowledge Sharing of Economics,Sociology,Law and Politics:A Comparative Study on Citations of Chinese Social Science Journals

A RevieW of the Research on the Evaluation of International Influence of Academic Achievements in Social Science

Analysis Of Academic Evaluation Indicators Based On Citation Quality

On the Relation between the Language/Editing Quality of Academic Journals and the Selective Conditions for Core Journals in China

Analysis of Citation Frequency and Citation Extent of Journalism & Communication Academic Journals(2004—2006)

Evaluation of the discourse power in Chinese academic journals: A multi-fusion perspective

A Comparative Study of the Citation Impact of Chinese Journals with Government Priority Support.