Abstract:Recent research has revealed that image-based methods can enhance accuracy and safety in laser microsurgery. In this study, non-rigid tracking using surgical stereo imaging and its application to laser ablation is discussed. A recently developed motion estimation framework based on piecewise affine deformation modeling is extended by a mesh refinement step and considering texture information. This compensates for tracking inaccuracies potentially caused by inconsistent feature matches or drift. To facilitate online application of the method, computational load is reduced by concurrent processing and affine-invariant fusion of tracking and refinement results. The residual latency-dependent tracking error is further minimized by Kalman filter-based upsampling, considering a motion model in disparity space. Accuracy is assessed in laparoscopic, beating heart, and laryngeal sequences with challenging conditions, such as partial occlusions and significant deformation. Performance is compared with that of state-of-the-art methods. In addition, the online capability of the method is evaluated by tracking two motion patterns performed by a high-precision parallel-kinematic platform. Related experiments are discussed for tissue substitute and porcine soft tissue in order to compare performances in an ideal scenario and in a setup mimicking clinical conditions. Regarding the soft tissue trial, the tracking error can be significantly reduced from 0.72 mm to below 0.05 mm with mesh refinement. To demonstrate online laser path adaptation during ablation, the non-rigid tracking framework is integrated into a setup consisting of a surgical Er:YAG laser, a three-axis scanning unit, and a low-noise stereo camera. Regardless of the error source, such as laser-to-camera registration, camera calibration, image-based tracking, and scanning latency, the ablation root mean square error is kept below 0.21 mm when the sample moves according to the aforementioned patterns. Final experiments regarding motion-compensated laser ablation of structurally deforming tissue highlight the potential of the method for vision-guided laser surgery.

Sampling-Based Model Predictive Control for Volumetric Ablation in Robotic Laser Surgery

3D Laser-and-tissue Agnostic Data-driven Method for Robotic Laser Surgical Planning

Refined Motion Compensation with Soft Laser Manipulators using Data-Driven Surrogate Models

Model predictive control for retinal laser treatment at 1 kHz

Latent regression based model predictive control for tissue triangulation

Robotic Laser Orientation Planning with a 3D Data-driven Method

Automatic Laser Ablation Control Algorithm for an Novel Endoscopic Laser Ablation End Effector for Precision Neurosurgery

Epipolar Geometry‐Based Visual Servoing of Soft Endoscopic Manipulator for Transoral Laser Ablation

StereoCNC: A Stereovision-guided Robotic Laser System

A prediction model for guiding tumor microwave ablation surgery based on simulation

Robust Multivariable Predictive Control for Laser-Aided Powder Deposition Processes

Stereo vision-based tracking of soft tissue motion with application to online ablation control in laser microsurgery

Parameter estimation and model reduction for retinal laser treatment

Trajectory Tracking Control of a Miniature Laser Manipulation Robotic End-Effector for Dental Preparation

Model Predictive Control for Tumor Motion Compensation in Robot Assisted Radiotherapy

Model-Predictive Control of Blood Suction for Surgical Hemostasis using Differentiable Fluid Simulations

Model Predictive Control of Melt Pool Size for the Laser Powder Bed Fusion Process Under Process Uncertainty

Model predictive control for real-time microstructure control in laser heat treatment

A Novel OCT Image-Guided Laser Automatic Ablation Method Based on Non-common Optical Path Structure

Robotic catheter cardiac ablation combining ultrasound guidance and force control

Autonomous Tissue Manipulation via Surgical Robot Using Learning Based Model Predictive Control