Abstract:Integrating machine learning (ML) models into clinical practice presents a challenge of maintaining their efficacy over time. While existing literature offers valuable strategies for detecting declining model performance, there is a need to document the broader challenges and solutions associated with the real-world development and integration of model monitoring solutions. This work details the development and use of a platform for monitoring the performance of a production-level ML model operating in Mayo Clinic. In this paper, we aimed to provide a series of considerations and guidelines necessary for integrating such a platform into a team's technical infrastructure and workflow. We have documented our experiences with this integration process, discussed the broader challenges encountered with real-world implementation and maintenance, and included the source code for the platform. Our monitoring platform was built as an R shiny application, developed and implemented over the course of 6 months. The platform has been used and maintained for 2 years and is still in use as of July 2023. The considerations necessary for the implementation of the monitoring platform center around 4 pillars: feasibility (what resources can be used for platform development?); design (through what statistics or models will the model be monitored, and how will these results be efficiently displayed to the end user?); implementation (how will this platform be built, and where will it exist within the IT ecosystem?); and policy (based on monitoring feedback, when and what actions will be taken to fix problems, and how will these problems be translated to clinical staff?). While much of the literature surrounding ML performance monitoring emphasizes methodological approaches for capturing changes in performance, there remains a battery of other challenges and considerations that must be addressed for successful real-world implementation.

Practical Statistical Considerations for the Clinical Validation of AI/ML-enabled Medical Diagnostic Devices

AI/ML in Precision Medicine: A Look Beyond the Hype

Requirements and reliability of AI in the medical context

Statistical Considerations and Challenges for Pivotal Clinical Studies of Artificial Intelligence Medical Tests for Widespread Use: Opportunities for Inter-Disciplinary Collaboration

Statistical Thinking, Machine Learning

On the Application of Artificial Intelligence/Machine Learning (AI/ML) in Late-Stage Clinical Development

Connecting Technological Innovation in Artificial Intelligence to Real-world Medical Practice through Rigorous Clinical Validation: What Peer-reviewed Medical Journals Could Do

Machine learning in medicine: a practical introduction to techniques for data pre-processing, hyperparameter tuning, and model comparison

Interpretation of Artificial Intelligence Models in Healthcare

Towards quality management of artificial intelligence systems for medical applications

A clinician's guide to understanding and critically appraising machine learning studies: a checklist for Ruling Out Bias Using Standard Tools in Machine Learning (ROBUST-ML)

Considerations for Quality Control Monitoring of Machine Learning Models in Clinical Practice

Breathing Life Into Artificial Intelligence*

Regulatory Aspects of Artificial Intelligence and Machine Learning

Clinical performance of automated machine learning: A systematic review

AI in imaging: the regulatory landscape

Sample Size Analysis for Machine Learning Clinical Validation Studies

Unlocking new potential of clinical diagnosis with artificial intelligence: Finding new patterns of clinical and lab data

Ten quick tips for ensuring machine learning model validity

Statistical learning and big data applications