Abstract:This paper proposes the first automated navigation strategies to explore and navigate in large, hollow anatomical structures with remote magnetic navigation during minimally invasive procedures. The methods relay on endoscopic image mosaics to provide surgeons with a map of the environment for surgical planning and localization. This approach promises to facilitate such procedures for the surgeons and enhance patient safety. Endoscopes navigate within the human body to observe anatomical structures with minimal invasiveness. A major shortcoming of their use is their narrow field‐of‐view during navigation in large, hollow anatomical regions. Mosaics of endoscopic images can provide surgeons with a map of the tool's environment. This would facilitate procedures, improve their efficiency, and potentially generate better patient outcomes. The emergence of magnetically steered endoscopes opens the way to safer procedures and creates an opportunity to provide robotic assistance both in the generation of the mosaic map and in navigation within this map. This paper proposes methods to autonomously navigate magnetic endoscopes to 1) generate endoscopic image mosaics and 2) use these mosaics as user interfaces to navigate throughout the explored area. These are the first strategies, which allow autonomous magnetic navigation in large, hollow organs during minimally invasive surgeries. The feasibility of these methods is demonstrated experimentally both in vitro and ex vivo in the context of the treatment of twin‐to‐twin transfusion syndrome. This minimally invasive procedure is performed in utero and necessitates coagulating shared vessels of twin fetuses on the placenta. A mosaic of the vasculature in combination with autonomous navigation has the potential to significantly facilitate this challenging surgery.

A Three-Dimensional Magnetic Tweezer System for Intraembryonic Navigation and Measurement.

Programmable Motion Control and Trajectory Manipulation of Microparticles Through Tri-Directional Symmetrical Acoustic Tweezers

A 3D magnetic tissue stretcher for remote mechanical control of embryonic stem cell differentiation

Quantifying Stiffness and Forces of Tumor Colonies and Embryos Using a Magnetic Microrobot.

Application of Mechanical Forces on Drosophila Embryos by Manipulation of Microinjected Magnetic Particles

Micromanipulation System for Microscale Magnetic Component Alignment and Assembly

Magnetic tweezers principles and promises

Magnetic Soft Microrobot Design for Cell Grasping and Transportation

3D Acoustic Manipulation of Living Cells and Organisms Based on 2D Array

Understanding Three-Dimensional Spatial Relationship Between the Mouse Second Polar Body and First Cleavage Plane with Full-Field Optical Coherence Tomography

On-chip manipulating and impedance spectroscopy sensing of single mouse embryo

TiFM2.0 - Versatile mechanical measurement and actuation in live embryos

Fully Integrated Microfluidic Device for Magnetic Bead Manipulation to Assist Rapid Reaction and Cleaning

An Untethered Magnetic Microgripper for High‐Throughput Micromanipulation (Adv. Mater. Technol. 10/2024)

Label-free subcellular 3D live imaging of preimplantation mouse embryos with full-field optical coherence tomography.

Self-Navigated 3D Acoustic Tweezers in Complex Media Based on Time Reversal

Design of Soft Microjoint to Improve Robotic Cell Micromanipulation Flexibility

Three-dimension transcriptomics maps of whole mouse embryo during organogenesis

Engineering Magnetic Micro/Nanorobots for Versatile Biomedical Applications

Magnetic Bead Manipulation in Microfluidic Chips for Biological Application

Autonomous Magnetic Navigation in Endoscopic Image Mosaics