Abstract:Background: The reporting of adverse events (AEs) relating to medical devices is a long-standing area of concern, with suboptimal reporting due to a range of factors including a failure to recognize the association of AEs with medical devices, lack of knowledge of how to report AEs, and a general culture of nonreporting. The introduction of artificial intelligence as a medical device (AIaMD) requires a robust safety monitoring environment that recognizes both generic risks of a medical device and some of the increasingly recognized risks of AIaMD (such as algorithmic bias). There is an urgent need to understand the limitations of current AE reporting systems and explore potential mechanisms for how AEs could be detected, attributed, and reported with a view to improving the early detection of safety signals. Objective: The systematic review outlined in this protocol aims to yield insights into the frequency and severity of AEs while characterizing the events using existing regulatory guidance. Methods: Publicly accessible AE databases will be searched to identify AE reports for AIaMD. Scoping searches have identified 3 regulatory territories for which public access to AE reports is provided: the United States, the United Kingdom, and Australia. AEs will be included for analysis if an artificial intelligence (AI) medical device is involved. Software as a medical device without AI is not within the scope of this review. Data extraction will be conducted using a data extraction tool designed for this review and will be done independently by AUK and a second reviewer. Descriptive analysis will be conducted to identify the types of AEs being reported, and their frequency, for different types of AIaMD. AEs will be analyzed and characterized according to existing regulatory guidance. Results: Scoping searches are being conducted with screening to begin in April 2024. Data extraction and synthesis will commence in May 2024, with planned completion by August 2024. The review will highlight the types of AEs being reported for different types of AI medical devices and where the gaps are. It is anticipated that there will be particularly low rates of reporting for indirect harms associated with AIaMD. Conclusions: To our knowledge, this will be the first systematic review of 3 different regulatory sources reporting AEs associated with AIaMD. The review will focus on real-world evidence, which brings certain limitations, compounded by the opacity of regulatory databases generally. The review will outline the characteristics and frequency of AEs reported for AIaMD and help regulators and policy makers to continue developing robust safety monitoring processes. International registered report identifier (irrid): PRR1-10.2196/48156.

Artificial intelligence related safety issues associated with FDA medical device reports

Health Disparities and Reporting Gaps in Artificial Intelligence (AI) Enabled Medical Devices: A Scoping Review of 692 U.S. Food and Drug Administration (FDA) 510k Approvals

FDA-Approved Artificial Intelligence and Machine Learning (AI/ML)-Enabled Medical Devices: An Updated Landscape

A scoping review of reporting gaps in FDA-approved AI medical devices

AI as a Medical Device Adverse Event Reporting in Regulatory Databases: Protocol for a Systematic Review

Regulatory Aspects of Artificial Intelligence and Machine Learning

The need for a system view to regulate artificial intelligence/machine learning-based software as medical device

Regulating the Safety of Health-Related Artificial Intelligence

Technology-Enabled, Evidence-Driven, and Patient-Centered: The Way Forward for Regulating Software as a Medical Device

FDA Perspective on the Regulation of Artificial Intelligence in Health Care and Biomedicine.

Data-Driven Analysis of AI in Medical Device Software in China: Deep Learning and General AI Trends Based on Regulatory Data

Artificial intelligence as a medical device in radiology: ethical and regulatory issues in Europe and the United States

Artificial intelligence in medical device software and high-risk medical devices – a review of definitions, expert recommendations and regulatory initiatives

Approval of artificial intelligence and machine learning-based medical devices in the USA and Europe (2015–20): a comparative analysis

Promoting Health Equity through Improved Regulation of Artificial Intelligence Medical Devices

How AI challenges the medical device regulation: patient safety, benefits, and intended uses

Bending the patient safety curve: how much can AI help?

Leveraging law and ethics to promote safe and reliable AI/ML in healthcare

Safety challenges of AI in medicine

Protecting Patient Safety and Privacy in the Era of Artificial Intelligence

Technical/Algorithm, Stakeholder, and Society (TASS) barriers to the application of artificial intelligence in medicine: A systematic review