Abstract:Importance Advances in artificial intelligence (AI) must be matched by efforts to better understand and evaluate how AI performs across health care and biomedicine as well as develop appropriate regulatory frameworks. This Special Communication reviews the history of the US Food and Drug Administration's (FDA) regulation of AI; presents potential uses of AI in medical product development, clinical research, and clinical care; and presents concepts that merit consideration as the regulatory system adapts to AI's unique challenges. Observations The FDA has authorized almost 1000 AI-enabled medical devices and has received hundreds of regulatory submissions for drugs that used AI in their discovery and development. Health AI regulation needs to be coordinated across all regulated industries, the US government, and with international organizations. Regulators will need to advance flexible mechanisms to keep up with the pace of change in AI across biomedicine and health care. Sponsors need to be transparent about and regulators need proficiency in evaluating the use of AI in premarket development. A life cycle management approach incorporating recurrent local postmarket performance monitoring should be central to health AI development. Special mechanisms to evaluate large language models and their uses are needed. Approaches are necessary to balance the needs of the entire spectrum of health ecosystem interests, from large firms to start-ups. The evaluation and regulatory system will need to focus on patient health outcomes to balance the use of AI for financial optimization for developers, payers, and health systems. Conclusions and Relevance Strong oversight by the FDA protects the long-term success of industries by focusing on evaluation to advance regulated technologies that improve health. The FDA will continue to play a central role in ensuring safe, effective, and trustworthy AI tools to improve the lives of patients and clinicians alike. However, all involved entities will need to attend to AI with the rigor this transformative technology merits.

Promoting Health Equity through Improved Regulation of Artificial Intelligence Medical Devices

Technology-Enabled, Evidence-Driven, and Patient-Centered: The Way Forward for Regulating Software as a Medical Device

Unexpected Inequality: Disparate-Impact From Artificial Intelligence in Healthcare Decisions

Health Disparities and Reporting Gaps in Artificial Intelligence (AI) Enabled Medical Devices: A Scoping Review of 692 U.S. Food and Drug Administration (FDA) 510k Approvals

The need for a system view to regulate artificial intelligence/machine learning-based software as medical device

Algorithmic fairness in artificial intelligence for medicine and healthcare

Algorithm Fairness in AI for Medicine and Healthcare

A scoping review of reporting gaps in FDA-approved AI medical devices

Bias Impact Analysis of AI in Consumer Mobile Health Technologies: Legal, Technical, and Policy

Racing into the fourth industrial revolution: exploring the ethical dimensions of medical AI and rights-based regulatory framework

AI-Driven Healthcare: A Survey on Ensuring Fairness and Mitigating Bias

The AI cycle of health inequity and digital ageism: mitigating biases through the EU regulatory framework on medical devices

Addressing Algorithmic Bias and the Perpetuation of Health Inequities: An AI Bias Aware Framework

Targeting Machine Learning and Artificial Intelligence Algorithms in Health Care to Reduce Bias and Improve Population Health

The bias algorithm: how AI in healthcare exacerbates ethnic and racial disparities – a scoping review

How AI challenges the medical device regulation: patient safety, benefits, and intended uses

Considerations for addressing bias in artificial intelligence for health equity

Bias in artificial intelligence algorithms and recommendations for mitigation

Responsible artificial intelligence for addressing equity in oral healthcare

FDA Perspective on the Regulation of Artificial Intelligence in Health Care and Biomedicine.