Abstract:Endovascular interventions are a life-saving treatment for many diseases, yet suffer from drawbacks such as radiation exposure and potential scarcity of proficient physicians. Robotic assistance during these interventions could be a promising support towards these problems. Research focusing on autonomous endovascular interventions utilizing artificial intelligence-based methodologies is gaining popularity. However, variability in assessment environments hinders the ability to compare and contrast the efficacy of different approaches, primarily due to each study employing a unique evaluation framework. In this study, we present deep reinforcement learning-based autonomous endovascular device navigation on three distinct digital benchmark interventions: BasicWireNav, ArchVariety, and DualDeviceNav. The benchmark interventions were implemented with our modular simulation framework stEVE (simulated EndoVascular Environment). Autonomous controllers were trained solely in simulation and evaluated in simulation and on physical test benches with camera and fluoroscopy feedback. Autonomous control for BasicWireNav and ArchVariety reached high success rates and was successfully transferred from the simulated training environment to the physical test benches, while autonomous control for DualDeviceNav reached a moderate success rate. The experiments demonstrate the feasibility of stEVE and its potential for transferring controllers trained in simulation to real-world scenarios. Nevertheless, they also reveal areas that offer opportunities for future research. This study demonstrates the transferability of autonomous controllers from simulation to the real world in endovascular navigation and lowers the entry barriers and increases the comparability of research on endovascular assistance systems by providing open-source training scripts, benchmarks and the stEVE framework.

Hierarchical HMM Based Learning of Navigation Primitives for Cooperative Robotic Endovascular Catheterization

Learning-based Endovascular Navigation Through the Use of Non-Rigid Registration for Collaborative Robotic Catheterization

Trajectory Optimization of Robot-Assisted Endovascular Catheterization with Reinforcement Learning

Collaborative Robot-Assisted Endovascular Catheterization with Generative Adversarial Imitation Learning

A Cooperative Control Framework for Haptic Guidance of Bimanual Surgical Tasks Based on Learning from Demonstration.

Motion-adapted Catheter Navigation with Real-Time Instantiation and Improved Visualisation.

Robust Path Planning via Learning from Demonstrations for Robotic Catheters in Deformable Environments

Adapting Neural-Based Models for Position Error Compensation in Robotic Catheter Systems

Towards Automated Surgical Skill Evaluation of Endovascular Catheterization Tasks Based on Force and Motion Signatures.

Haptic Feedback and Dynamic Active Constraints for Robot-Assisted Endovascular Catheterization

A Learning Based Training and Skill Assessment Platform with Haptic Guidance for Endovascular Catheterization

Learning automatic navigation control skills for miniature helical robots from human demonstrations

Learning-Based Autonomous Navigation, Benchmark Environments and Simulation Framework for Endovascular Interventions

A Learning-Based Hierarchical Control Scheme for an Exoskeleton Robot in Human-Robot Cooperative Manipulation.

Autonomous Catheterization with Open-source Simulator and Expert Trajectory

A Deep Multimodal Network for Classification and Identification of Interventionists' Hand Motions during Cyborg Intravascular Catheterization

An Endovascular Catheterization Robotic System Using Collaborative Operation with Magnetically Controlled Haptic Force Feedback

Hierarchical Robot Learning for Physical Collaboration Between Humans and Robots

Learning-based Parameter Estimation for Hysteresis Modeling in Robotic Catheterization

A Novel Robot-Assisted Endovascular Catheterization System With Haptic Force Feedback

Design and Hierarchical Control of a Homocentric Variable-Stiffness Magnetic Catheter for Multiarm Robotic Ultrasound-Assisted Coronary Intervention