Scientific and technological knowledge grows linearly over time

Huquan Kang,Luoyi Fu,Russell J. Funk,Xinbing Wang,Jiaxin Ding,Shiyu Liang,Jianghao Wang,Lei Zhou,Chenghu Zhou

2024-09-13

Abstract:The past few centuries have witnessed a dramatic growth in scientific and technological knowledge. However, the nature of that growth - whether exponential or otherwise - remains controversial, perhaps partly due to the lack of quantitative characterizations. We evaluated knowledge as a collective thinking structure, using citation networks as a representation, by examining extensive datasets that include 213 million publications (1800-2020) and 7.6 million patents (1976-2020). We found that knowledge - which we conceptualize as the reduction of uncertainty in a knowledge network - grew linearly over time in naturally formed citation networks that themselves expanded exponentially. Moreover, our results revealed inflection points in the growth of knowledge that often corresponded to important developments within fields, such as major breakthroughs, new paradigms, or the emergence of entirely new areas of study. Around these inflection points, knowledge may grow rapidly or exponentially on a local scale, although the overall growth rate remains linear when viewed globally. Previous studies concluding an exponential growth of knowledge may have focused primarily on these local bursts of rapid growth around key developments, leading to the misconception of a global exponential trend. Our findings help to reconcile the discrepancy between the perceived exponential growth and the actual linear growth of knowledge by highlighting the distinction between local and global growth patterns. Overall, our findings reveal major science development trends for policymaking, showing that producing knowledge is far more challenging than producing papers.

Physics and Society,Information Theory,Social and Information Networks

What problem does this paper attempt to address?

The core problem that this paper attempts to solve is the growth pattern of scientific and technological knowledge. Specifically, the authors explore whether the growth of scientific knowledge is exponential, as is generally believed, or actually linear. By analyzing a large amount of publication and patent data, the paper aims to quantify the growth of knowledge and reveal its real development trend. In addition, the paper also explores the inflection point phenomenon in knowledge growth and the relationship between these inflection points and scientific breakthroughs.

### Main research questions:
1. **Pattern of knowledge growth**: Is the growth of scientific knowledge exponential or linear?
2. **Inflection point phenomenon**: Are there significant inflection points in the process of knowledge growth? Are these inflection points related to important scientific breakthroughs?
3. **Relationship between knowledge growth and publication growth**: Why does the number of scientific publications grow exponentially while the growth of knowledge itself may be linear?

### Research methods:
- **Data sources**: The paper uses data from 213 million publications (1800 - 2020) in the Microsoft Academic Graph (MAG) and 7.6 million patents (1976 - 2020) of the United States Patent and Trademark Office (USPTO).
- **Knowledge Quantification Indicator (KQI)**: The authors introduce a new indicator - the Knowledge Quantification Index (KQI) - to quantify the growth of knowledge. KQI is defined as the difference between the Shannon entropy of the node - degree distribution and the structural entropy of the citation network.
- **Linear regression and exponential regression**: By performing linear regression and exponential regression on KQI and the number of publications, and comparing the fitting effects of the two models, to determine which model can better reflect the growth trend of knowledge.
- **Inflection point analysis**: By analyzing the changes of KQI in different disciplines and fields, identify the inflection points in knowledge growth and explore the relationship between these inflection points and scientific breakthroughs.

### Main findings:
- **Linear knowledge growth**: Although the number of scientific publications grows exponentially, the growth of knowledge itself shows a linear trend.
- **Inflection points and scientific breakthroughs**: There are significant inflection points in knowledge growth, and these inflection points are usually related to important scientific breakthroughs or the emergence of new fields.
- **Diminishing marginal returns of knowledge growth**: With the continuous increase of scientific literature, the contribution of each newly published article to knowledge growth gradually decreases, which conforms to the Pareto principle.

### Significance:
- **Policy - making**: Understanding the real pattern of knowledge growth is helpful for the formulation of scientific policies, the rational allocation of resources, and the promotion of scientific innovation.
- **Scientific research**: Revealing the linear trend and inflection point phenomenon of knowledge growth helps scientists better understand the laws of scientific development and guide future research directions.
- **Academic evaluation**: As a new knowledge quantification indicator, KQI provides a new tool for academic evaluation and helps to measure the achievements of scientific research more accurately.

In conclusion, through a large amount of data analysis, this paper reveals the real pattern of scientific knowledge growth and provides an important reference for scientific policy - making and scientific research.