Abstract:The rapid development of modern science nowadays makes it rather challenging to pick out valuable ideas from massive scientific literature. Existing widely-adopted citation-based metrics are not adequate for measuring how well the idea presented by a single publication is developed and whether it is worth following. Here, inspired by traditional X-ray imaging, which returns internal structure imaging of real objects along with corresponding structure analysis, we propose Scientific X-ray, a framework that quantifies the development degree and development potential for any scientific idea through an assembly of 'X-ray' scanning, visualization and parsing operated on the citation network associated with a target publication. We pick all 71,431 scientific articles of citation counts over 1,000 as high-impact target publications among totally 204,664,199 publications that cover 16 disciplines spanning from 1800 to 2021. Our proposed Scientific X-ray reproduces how an idea evolves from the very original target publication all the way to the up to date status via an extracted 'idea tree' that attempts to preserve the most representative idea flow structure underneath each citation network. Interestingly, we observe that while the citation counts of publications may increase unlimitedly, the maximum valid idea inheritance of those target publications, i.e., the valid depth of the idea tree, cannot exceed a limit of six hops, and the idea evolution structure of any arbitrary publication unexceptionally falls into six fixed patterns. Combined with a development potential index that we further design based on the extracted idea tree, Scientific X-ray can vividly tell how further a given idea presented by a given publication can still go from any well-established starting point. Scientific X-ray successfully identifies 40 out of 49 topics of Nobel prize as high-potential topics by their prize-winning papers in an average of nine years before the prizes are released. Various trials on articles of diverse topics also confirm the power of Scientific X-ray in digging out influential/promising ideas. Scientific X-ray is user-friendly to researchers with any level of expertise, thus providing important basis for grasping research trends, helping scientific policy-making and even promoting social development.

Comprehensive Evaluation of XSEDE’s Scientific Impact using Semantic Scholar Data

Scientometrics of Big Science: a Case Study of Research in the Sloan Digital Sky Survey

The Semantic Scholar Open Data Platform

Scientific X-ray: Scanning and quantifying the idea evolution of scientific publications

A Data Analytic Approach to Quantifying Scientific Impact

Making sense of the evolution of a scientific domain: a visual analytic study of the Sloan Digital Sky Survey research

Delineating the Citation Impact of Scientific Discoveries

Quantifying Success in Science: An Overview

An Empirical Study on Visualizing the Intellectual Structure and Hotspots of Big Data Research from a Sustainable Perspective

Bibliometric study on environmental, social, and governance research using CiteSpace

Assessment of Sustainable Funding Impact by Exploiting Research Performance Indicators and Semantic Techniques

Scientometric engineering: Exploring citation dynamics via arXiv eprints

Measuring prominence of scientific work in online news as a proxy for impact

SMIAltmetric: A Comprehensive Metric for Evaluating Social Media Impact of Scientific Papers on Twitter (X)

Using Bibliometric Analysis to Map the Impact of a Simulation Program's Published Scholarly Works

Scopus as a curated, high-quality bibliometric data source for academic research in quantitative science studies

Evaluating the (in)accessibility of data behind papers in astronomy

Semantic Publishing Challenge -- Assessing the Quality of Scientific Output

Assessment of the impact of shared data on the scientific literature

The Future of Science: Big Data Meets Scholarly Impact

Analyzing knowledge flows of scientific literature through semantic links: a case study in the field of energy