Abstract:Objectives: Health economic evaluations (HEEs) help healthcare decision makers understand the value of new technologies. Artificial intelligence (AI) is increasingly being used in healthcare interventions. We sought to review the conduct and reporting of published HEEs for AI-based health interventions. Methods: We conducted a systematic literature review with a 15-month search window (April 2021 to June 2022) on 17 th June 2022 to identify HEEs of AI health interventions and update a previous review. Records were identified from 3 databases (Medline, Embase, and Cochrane Central). Two reviewers screened papers against predefined study selection criteria. Data were extracted from included studies using prespecified data extraction tables. Included studies were quality assessed using the National Institute for Health and Care Excellence (NICE) checklist. Results were synthesized narratively. Results: A total of 21 studies were included. The most common type of AI intervention was automated image analysis (9/21, 43%) mainly used for screening or diagnosis in general medicine and oncology. Nearly all were cost-utility (10/21, 48%) or cost-effectiveness analyses (8/21, 38%) that took a healthcare system or payer perspective. Decision-analytic models were used in 16/21 (76%) studies, mostly Markov models and decision trees. Three (3/16, 19%) used a short-term decision tree followed by a longer-term Markov component. Thirteen studies (13/21, 62%) reported the AI intervention to be cost effective or dominant. Limitations tended to result from the input data, authorship conflicts of interest, and a lack of transparent reporting, especially regarding the AI nature of the intervention. Conclusion: Published HEEs of AI-based health interventions are rapidly increasing in number. Despite the potentially innovative nature of AI, most have used traditional methods like Markov models or decision trees. Most attempted to assess the impact on quality of life to present the cost per QALY gained. However, studies have not been comprehensively reported. Specific reporting standards for the economic evaluation of AI interventions would help improve transparency and promote their usefulness for decision making. This is fundamental for reimbursement decisions, which in turn will generate the necessary data to develop flexible models better suited to capturing the potentially dynamic nature of AI interventions.

Ethical guidance for reporting and evaluating claims of AI outperforming human doctors

Reporting guidelines in medical artificial intelligence: a systematic review and meta-analysis

A practical guide to the implementation of AI in orthopaedic research, Part 6: How to evaluate the performance of AI research?

Ethical debates amidst flawed healthcare artificial intelligence metrics

Presenting artificial intelligence, deep learning, and machine learning studies to clinicians and healthcare stakeholders: an introductory reference with a guideline and a Clinical AI Research (CAIR) checklist proposal

Meta-research on reporting guidelines for artificial intelligence: are authors and reviewers encouraged enough in radiology, nuclear medicine, and medical imaging journals?

The Debate on the Ethics of AI in Health Care: a Reconstruction and Critical Review

Reporting guidelines for clinical trials of artificial intelligence interventions: the SPIRIT-AI and CONSORT-AI guidelines

PRISMA AI reporting guidelines for systematic reviews and meta-analyses on AI in healthcare

An ethics assessment tool for artificial intelligence implementation in healthcare: CARE-AI

Moving beyond algorithmic accuracy to improving user interaction with clinical AI

Artificial intelligence innovation in healthcare: Relevance of reporting guidelines for clinical translation from bench to bedside

Guidelines, Consensus Statements, and Standards for the Use of Artificial Intelligence in Medicine: Systematic Review

Ethics & AI: A Systematic Review on Ethical Concerns and Related Strategies for Designing with AI in Healthcare

Guidelines and Standard Frameworks for Artificial Intelligence in Medicine: A Systematic Review

Machine learning and AI research for Patient Benefit: 20 Critical Questions on Transparency, Replicability, Ethics and Effectiveness

Artificial Intelligence Reporting Guidelines' Adherence in Nephrology for Improved Research and Clinical Outcomes

Guidelines for Artificial Intelligence in Medicine: Literature Review and Content Analysis of Frameworks

Economic evaluations of artificial intelligence-based healthcare interventions: A systematic literature review of best practices in their conduct and reporting

Ethical Dilemmas in Using AI for Academic Writing and an Example Framework for Peer Review in Nephrology Academia: A Narrative Review

Reporting Quality of Research Studies on AI Applications in Medical Images According to the CLAIM Guidelines in a Radiology Journal With a Strong Prominence in Asia