Generative AI for Health Technology Assessment: Opportunities, Challenges, and Policy Considerations

Rachael Fleurence,Jiang Bian,Xiaoyan Wang,Hua Xu,Dalia Dawoud,Mitch Higashi,Jagpreet Chhatwal

2024-09-22

Abstract:This review introduces the transformative potential of generative Artificial Intelligence (AI) and foundation models, including large language models (LLMs), for health technology assessment (HTA). We explore their applications in four critical areas, evidence synthesis, evidence generation, clinical trials and economic modeling: (1) Evidence synthesis: Generative AI has the potential to assist in automating literature reviews and meta-analyses by proposing search terms, screening abstracts, and extracting data with notable accuracy; (2) Evidence generation: These models can potentially facilitate automating the process and analyze the increasingly available large collections of real-world data (RWD), including unstructured clinical notes and imaging, enhancing the speed and quality of real-world evidence (RWE) generation; (3) Clinical trials: Generative AI can be used to optimize trial design, improve patient matching, and manage trial data more efficiently; and (4) Economic modeling: Generative AI can also aid in the development of health economic models, from conceptualization to validation, thus streamlining the overall HTA process. Despite their promise, these technologies, while rapidly improving, are still nascent and continued careful evaluation in their applications to HTA is required. To ensure their responsible use and implementation, both developers and users of research incorporating these tools, should familiarize themselves with their current limitations, including the issues related to scientific validity, risk of bias, and consider equity and ethical implications. We also surveyed the current policy landscape and provide suggestions for HTA agencies on responsibly integrating generative AI into their workflows, emphasizing the importance of human oversight and the fast-evolving nature of these tools.

Machine Learning,Artificial Intelligence

What problem does this paper attempt to address?

This paper aims to explore the application opportunities, challenges, and policy considerations of generative artificial intelligence (Generative AI) and its foundation models (including large - language models, LLMs) in the field of health technology assessment (Health Technology Assessment, HTA). Specifically:

1. **Literature Review and Evidence Synthesis**: Generative AI has the potential to automate parts of the systematic literature review by suggesting search terms, screening abstracts, extracting data, and generating meta - analysis codes, etc.
2. **Real - World Evidence (RWE)**: Generative AI can promote automated processing procedures and analyze a large amount of real - world data (RWD), including unstructured clinical notes and imaging data.
3. **Health Economics Modeling**: Generative AI can assist in the development of health economic models throughout the process from conceptualization to validation.

However, the application of these technologies also faces some limitations and risks, such as issues of scientific rigor and reliability, potential biases, impacts on fairness, and non - trivial challenges in complying with regulatory and ethical standards, especially in terms of data privacy and security. In addition, the article also outlines the current policy environment and provides suggestions for HTA institutions on how to responsibly integrate generative AI into their work processes, emphasizing the importance of human supervision and the rapidly evolving nature of these tools.