Abstract:By utilizing statistical methods to analyze bibliographic data, bibliometrics faces inherent limitations in identifying the most significant science and technology achievements and researchers. To overcome this challenge, we present an evaluatology-based science and technology evaluation methodology. At the heart of this approach lies the concept of an extended evaluation condition, encompassing eight crucial components derived from a field. We define four relationships that illustrate the connections among various achievements based on their mapped extended EC components, as well as their temporal and citation links. Within a relationship under an extended evaluation condition, evaluators can effectively compare these achievements by carefully addressing the influence of confounding variables. We establish a real-world evaluation system encompassing an entire collection of achievements, each of which is mapped to several components of an extended EC. Within a specific field like chip technology or open source, we construct a perfect evaluation model that can accurately trace the evolution and development of all achievements in terms of four relationships based on the real-world evaluation system. Building upon the foundation of the perfect evaluation model, we put forth four-round rules to eliminate non-significant achievements by utilizing four relationships. This process allows us to establish a pragmatic evaluation model that effectively captures the essential achievements, serving as a curated collection of the top N achievements within a specific field during a specific timeframe. We present a case study on the top 100 Chip achievements which highlights its practical application and efficacy in identifying significant achievements and researchers that otherwise can not be identified by using bibliometrics.

Statistical Model of Scientific Research Evaluation

ON THE EVALUATION MODEL OF SCIENTIFIC RESEARCH ACHIEVEMENTS AND THEIR GAUGING SYSTEM IN COLLEGES/DEPARTMENTS OF UNIVERSITIES

Model-based evaluation of scientific impact indicators

A Theoretical Model of Scientific Impact Based on Citations

Introduction to H-index and G-index for Journal Academic Impact Evaluation

Exploring the limitations of the h-index and h-type indexes in measuring the research performance of authors

Some Generalized Integrals Applied in Scientometrics and Related Evaluation

Studies on Utilizing the Three Famous International Index Systems to Evaluate Scientific Research Level of Higher Learning Institutions

The x-index: A new citation-distance-based index to measure academic influence

The Science and Technology Evaluation Model Based on Revised G1 by Standard Deviation and Empirical Research

New Exploratory Work of Evaluating a Researcher’s Output

International Performance of Chinese Institutes in Different Disciplines——A Bibliometric View

The New Research on Application of Bibliometrics in Individual's Evaluation——Apply for the Measure of H-index

Research of Scientific Performance Evaluation Based on hα- Index in Different Disciplines

Modeling Topic-Level Academic Influence in Scientific Literatures.

The Implications of Some Evaluation Index of Humanities and Social Sciences Research Achievements and Their Logical Relationship

The strike rate index: a new index for journal quality based on journal size and the h-index of citations

Journal Influence Evaluation Methods Based on Nonparametric Statistics

Could Bibliometrics Reveal Top Science and Technology Achievements and Researchers? The Case for Evaluatology-based Science and Technology Evaluation

Quantitative analysis of automatic performance evaluation systems based on the h-index

Research on the Evaluation of Scientists Based on Weighted h-index