Abstract:Motivation Medical image analysis involves a series of tasks used to assist physicians in qualitative and quantitative analyses of lesions or anatomical structures which can significantly improve the accuracy and reliability of medical diagnoses and prognoses. Traditionally, these tedious tasks were finished by experienced physicians or medical physicists and were marred with two major problems, low efficiency and bias. In the past decade, many machine learning methods have been applied to accelerate and automate the image analysis process. Compared to the enormous deployments of supervised and unsupervised learning models, attempts to use reinforcement learning in medical image analysis are still scarce. We hope that this review article could serve as the stepping stone for related research in the future. Significance We found that although reinforcement learning has gradually gained momentum in recent years, many researchers in the medical analysis field still find it hard to understand and deploy in clinical settings. One possible cause is a lack of well‐organized review articles intended for readers without professional computer science backgrounds. Rather than to provide a comprehensive list of all reinforcement learning models applied in medical image analysis, the aim of this review is to help the readers formulate and solve their medical image analysis research through the lens of reinforcement learning. Approach & Results We selected published articles from Google Scholar and PubMed. Considering the scarcity of related articles, we also included some outstanding newest preprints. The papers were carefully reviewed and categorized according to the type of image analysis task. In this article, we first reviewed the basic concepts and popular models of reinforcement learning. Then, we explored the applications of reinforcement learning models in medical image analysis. Finally, we concluded the article by discussing the reviewed reinforcement learning approaches' limitations and possible future improvements.

Deep Reinforcement Active Learning for Medical Image Classification

Image Classification with Deep Reinforcement Active Learning

Deep reinforced active learning for multi-class image classification

Active Learning for Image Classification: A Deep Reinforcement Learning Approach

Batch Mode Active Learning and Its Application to Medical Image Classification

A comprehensive survey on deep active learning in medical image analysis

Gated Deep Reinforcement Learning With Red Deer Optimization for Medical Image Classification

Learning a Diagnostic Strategy on Medical Data with Deep Reinforcement Learning

Deep reinforcement learning in medical imaging: A literature review

Reinforcement learning in medical image analysis: Concepts, applications, challenges, and future directions

Deep reinforcement learning and its applications in medical imaging and radiation therapy: a survey

An Adaptive Low-Rank Modeling-Based Active Learning Method for Medical Image Annotation

Reinforcing Medical Image Classifier to Improve Generalization on Small Datasets

Active Learning on Medical Image

An Adaptive Query Approach for Extracting Medical Images for Disease Detection Applications

Deep Reinforcement Learning for Dynamic Treatment Regimes on Medical Registry Data

Highly Efficient Representation and Active Learning Framework and Its Application to Imbalanced Medical Image Classification

Diminishing Uncertainty Within the Training Pool: Active Learning for Medical Image Segmentation

Label-Efficient Deep Learning in Medical Image Analysis: Challenges and Future Directions

Active Learning with Noise Modeling for Medical Image Annotation

O-MedAL: Online Active Deep Learning for Medical Image Analysis