Abstract:Endovascular interventions are a life-saving treatment for many diseases, yet suffer from drawbacks such as radiation exposure and potential scarcity of proficient physicians. Robotic assistance during these interventions could be a promising support towards these problems. Research focusing on autonomous endovascular interventions utilizing artificial intelligence-based methodologies is gaining popularity. However, variability in assessment environments hinders the ability to compare and contrast the efficacy of different approaches, primarily due to each study employing a unique evaluation framework. In this study, we present deep reinforcement learning-based autonomous endovascular device navigation on three distinct digital benchmark interventions: BasicWireNav, ArchVariety, and DualDeviceNav. The benchmark interventions were implemented with our modular simulation framework stEVE (simulated EndoVascular Environment). Autonomous controllers were trained solely in simulation and evaluated in simulation and on physical test benches with camera and fluoroscopy feedback. Autonomous control for BasicWireNav and ArchVariety reached high success rates and was successfully transferred from the simulated training environment to the physical test benches, while autonomous control for DualDeviceNav reached a moderate success rate. The experiments demonstrate the feasibility of stEVE and its potential for transferring controllers trained in simulation to real-world scenarios. Nevertheless, they also reveal areas that offer opportunities for future research. This study demonstrates the transferability of autonomous controllers from simulation to the real world in endovascular navigation and lowers the entry barriers and increases the comparability of research on endovascular assistance systems by providing open-source training scripts, benchmarks and the stEVE framework.

A zero-shot reinforcement learning strategy for autonomous guidewire navigation

A Zero-Shot Reinforcement Learning Strategy for Autonomous Guidewire Navigation

Deep reinforcement learning for guidewire navigation in coronary artery phantom

Autonomous navigation of catheters and guidewires in mechanical thrombectomy using inverse reinforcement learning

Image-Guided Autonomous Guidewire Navigation in Robot-Assisted Endovascular Interventions using Reinforcement Learning

Trajectory Optimization of Robot-Assisted Endovascular Catheterization with Reinforcement Learning

Collaborative Robot-Assisted Endovascular Catheterization with Generative Adversarial Imitation Learning

Learning-Based Autonomous Navigation, Benchmark Environments and Simulation Framework for Endovascular Interventions

AI-based Agents for Automated Robotic Endovascular Guidewire Manipulation

Hierarchical deep reinforcement learning controlled three-dimensional navigation of microrobots in blood vessels

Learning-based Endovascular Navigation Through the Use of Non-Rigid Registration for Collaborative Robotic Catheterization

Hierarchical Planning with Deep Reinforcement Learning for 3D Navigation of Microrobots in Blood Vessels

Towards Autonomous Robotic Ultrasound Scanning Using the Reinforcement Learning-Based Volumetric Data Navigation Method

VascularPilot3D: Toward a 3D fully autonomous navigation for endovascular robotics

Guidewire Navigation and Delivery System for Robot-Assisted Cardiology Interventions

Learning automatic navigation control skills for miniature helical robots from human demonstrations

Hierarchical HMM Based Learning of Navigation Primitives for Cooperative Robotic Endovascular Catheterization

Accelerated Intravascular Ultrasound Imaging using Deep Reinforcement Learning

Auxiliary Input in Training: Incorporating Catheter Features into Deep Learning Models for ECG-Free Dynamic Coronary Roadmapping

A Deep-Learning-Based Guidewire Compliant Control Method for the Endovascular Surgery Robot