Abstract:Motivation Medical image analysis involves a series of tasks used to assist physicians in qualitative and quantitative analyses of lesions or anatomical structures which can significantly improve the accuracy and reliability of medical diagnoses and prognoses. Traditionally, these tedious tasks were finished by experienced physicians or medical physicists and were marred with two major problems, low efficiency and bias. In the past decade, many machine learning methods have been applied to accelerate and automate the image analysis process. Compared to the enormous deployments of supervised and unsupervised learning models, attempts to use reinforcement learning in medical image analysis are still scarce. We hope that this review article could serve as the stepping stone for related research in the future. Significance We found that although reinforcement learning has gradually gained momentum in recent years, many researchers in the medical analysis field still find it hard to understand and deploy in clinical settings. One possible cause is a lack of well‐organized review articles intended for readers without professional computer science backgrounds. Rather than to provide a comprehensive list of all reinforcement learning models applied in medical image analysis, the aim of this review is to help the readers formulate and solve their medical image analysis research through the lens of reinforcement learning. Approach & Results We selected published articles from Google Scholar and PubMed. Considering the scarcity of related articles, we also included some outstanding newest preprints. The papers were carefully reviewed and categorized according to the type of image analysis task. In this article, we first reviewed the basic concepts and popular models of reinforcement learning. Then, we explored the applications of reinforcement learning models in medical image analysis. Finally, we concluded the article by discussing the reviewed reinforcement learning approaches' limitations and possible future improvements.

Machine learning for medical imaging: methodological failures and recommendations for the future

Machine Learning and Bias in Medical Imaging: Opportunities and Challenges

Machine Learning Empowering Personalized Medicine: A Comprehensive Review of Medical Image Analysis Methods

Key Technology Considerations in Developing and Deploying Machine Learning Models in Clinical Radiology Practice

Bias in artificial intelligence for medical imaging: fundamentals, detection, avoidance, mitigation, challenges, ethics, and prospects

Toward fairness in artificial intelligence for medical image analysis: identification and mitigation of potential biases in the roadmap from data collection to model deployment

Computer vision and machine learning for medical image analysis: recent advances, challenges, and way forward

Bias Assessment and Data Drift Detection in Medical Image Analysis: A Survey

Reinforcement learning in medical image analysis: Concepts, applications, challenges, and future directions

A Review of Deep Learning in Medical Imaging: Imaging Traits, Technology Trends, Case Studies With Progress Highlights, and Future Promises

Towards objective and systematic evaluation of bias in artificial intelligence for medical imaging

Artificial intelligence and machine learning for medical imaging: A technology review

Machine learning and artificial intelligence research for patient benefit: 20 critical questions on transparency, replicability, ethics, and effectiveness

Radiological images and machine learning: Trends, perspectives, and prospects

AI in Medical Imaging Informatics: Current Challenges and Future Directions

Strategies for Implementing Machine Learning Algorithms in the Clinical Practice of Radiology

Cardiac imaging: working towards fully-automated machine analysis & interpretation

The Limits of Fair Medical Imaging AI In The Wild