X-ray Fluoroscopy Guided Localization and Steering of Medical Microrobots through Virtual Enhancement

Husnu Halid Alabay,Tuan-Anh Le,Hakan Ceylan

2024-09-13

Abstract:In developing medical interventions using untethered milli- and microrobots, ensuring safety and effectiveness relies on robust methods for detection, real-time tracking, and precise localization within the body. However, the inherent non-transparency of the human body poses a significant obstacle, limiting robot detection primarily to specialized imaging systems such as X-ray fluoroscopy, which often lack crucial anatomical details. Consequently, the robot operator (human or machine) would encounter severe challenges in accurately determining the location of the robot and steering its motion. This study explores the feasibility of circumventing this challenge by creating a simulation environment that contains the precise digital replica (virtual twin) of a model microrobot operational workspace. Synchronizing coordinate systems between the virtual and real worlds and continuously integrating microrobot position data from the image stream into the virtual twin allows the microrobot operator to control navigation in the virtual world. We validate this concept by demonstrating the tracking and steering of a mobile magnetic robot in confined phantoms with high temporal resolution (< 100 ms, with an average of ~20 ms) visual feedback. Additionally, our object detection-based localization approach offers the potential to reduce overall patient exposure to X-ray doses during continuous microrobot tracking without compromising tracking accuracy. Ultimately, we address a critical gap in developing image-guided remote interventions with untethered medical microrobots, particularly for near-future applications in animal models and human patients.

Robotics

What problem does this paper attempt to address?

The paper aims to address the issues of detection, real-time tracking, and precise localization faced by micro-medical robots during in vivo operations. Specifically:

1. **Detection and Localization Challenges**: The non-transparent nature of the human body limits robot detection to specialized imaging systems such as X-ray fluoroscopy. These systems often lack critical anatomical details, making it difficult for robot operators to accurately determine the robot's position and control its movement.

2. **Proposed Solution**: To overcome this challenge, a simulated environment containing an accurate digital replica (virtual twin) of the micro-robot's workspace is created. By synchronizing the coordinate systems of the virtual and real worlds and continuously integrating robot position data from the image stream into the virtual twin, operators can control navigation in the virtual world. The method to validate this concept involves demonstrating the tracking and manipulation capabilities of a mobile magnetic robot in a constrained model, with high temporal resolution visual feedback (<100 milliseconds, averaging around 20 milliseconds).

3. **Reducing Radiation Exposure**: The study also explores a target detection-based localization method that promises to not increase the patient's X-ray dose exposure during continuous tracking of the micro-robot, thereby enhancing safety.

In summary, this research aims to fill a critical gap in image-guided remote medical interventions, particularly for future applications in animal models and human patients.