Quantifying the Benefit of Artificial Intelligence for Scientific Research

Jian Gao,Dashun Wang

2024-06-01

Abstract:The ongoing artificial intelligence (AI) revolution has the potential to change almost every line of work. As AI capabilities continue to improve in accuracy, robustness, and reach, AI may outperform and even replace human experts across many valuable tasks. Despite enormous effort devoted to understanding the impact of AI on labor and the economy and AI's recent successes in accelerating scientific discovery and progress, we lack a systematic understanding of how AI advances may benefit scientific research across disciplines and fields. Here, drawing from the literature on the future of work and the science of science, we develop a measurement framework to estimate both the direct use of AI and the potential benefit of AI in scientific research, applying natural language processing techniques to 74.6 million publications and 7.1 million patents. We find that the use of AI in research is widespread throughout the sciences, growing especially rapidly since 2015, and papers that use AI exhibit a citation premium, more likely to be highly cited both within and outside their disciplines. Moreover, our analysis reveals considerable potential for AI to benefit numerous scientific fields, yet a notable disconnect exists between AI education and its research applications, highlighting a mismatch between the supply of AI expertise and its demand in research. Lastly, we examine demographic disparities in AI's benefits across scientific disciplines and find that disciplines with a higher proportion of women or Black scientists tend to be associated with less benefit, suggesting that AI's growing impact on research may further exacerbate existing inequalities in science. As the connection between AI and scientific research deepens, our findings may become increasingly important, with implications for the equity and sustainability of the research enterprise.

Digital Libraries,Artificial Intelligence,Computers and Society,Data Analysis, Statistics and Probability,Physics and Society

What problem does this paper attempt to address?

The problem this paper attempts to address is: how to systematically quantify the impact of Artificial Intelligence (AI) on scientific research. Specifically, the authors develop a measurement framework aimed at estimating the direct use of AI in different disciplines and research fields, as well as its potential benefits. By analyzing 876,000 publications and 71,000 patents, the paper explores the following aspects:

1. **Direct Use of AI in Scientific Research**: By extracting and analyzing keywords (such as "machine learning," "deep learning," etc.) from AI-related papers and patents, the study evaluates the application of AI in various disciplines and its changing trends.

2. **Potential Impact of AI on Scientific Research**: Using natural language processing techniques, the study extracts verb-noun pairs from AI-related literature to infer AI's capabilities and matches them with the core tasks of various disciplines, thereby predicting AI's potential impact in these fields.

3. **Mismatch Between AI Education and Research Needs**: By analyzing 4.6 million university course syllabi, the study explores the relationship between the level of AI education and the actual impact of AI in scientific research, finding a significant mismatch between the two.

4. **Differences in Beneficiaries of AI in Research**: The study examines how scientists from different gender and racial backgrounds benefit from AI, discovering inequalities in AI benefits for female scientists and minority scientists.

Overall, the paper aims to provide a comprehensive understanding of AI's impact on scientific research through quantitative analysis, offering a basis for the formulation of science and education policies.