Abstract:Purpose: Countertraction is a vital technique in laparoscopic surgery, stretching the tissue surface for incision and dissection. Due to the technical challenges and frequency of countertraction, autonomous countertraction has the potential to significantly reduce surgeons' workload. Despite several methods proposed for automation, achieving optimal tissue visibility and tension for incision remains unrealized. Therefore, we propose a method for autonomous countertraction that enhances tissue surface planarity and visibility. Methods: We constructed a neural network that integrates a point cloud convolutional neural network (CNN) with a deep reinforcement learning (RL) model. This network continuously controls the forceps position based on the surface shape observed by a camera and the forceps position. RL is conducted in a physical simulation environment, with verification experiments performed in both simulation and phantom environments. The evaluation was performed based on plane error, representing the average distance between the tissue surface and its least-squares plane, and angle error, indicating the angle between the tissue surface vector and the camera's optical axis vector. Results: The plane error decreased under all conditions both simulation and phantom environments, with 93.3% of case showing a reduction in angle error. In simulations, the plane error decreased from 3.6 ± 1.5 mm to 1.1 ± 1.8 mm , and the angle error from 29 ± 19 ∘ to 14 ± 13 ∘ . In the phantom environment, the plane error decreased from 0.96 ± 0.24 mm to 0.39 ± 0.23 mm , and the angle error from 32 ± 29 ∘ to 17 ± 20 ∘ . Conclusion: The proposed neural network was validated in both simulation and phantom experimental settings, confirming that traction control improved tissue planarity and visibility. These results demonstrate the feasibility of automating countertraction using the proposed model.

A Novel Model-Independent Approach for Autonomous Retraction of Soft Tissue

Autonomous Soft Tissue Retraction Using Demonstration-Guided Reinforcement Learning

InterRep: A Visual Interaction Representation for Robotic Grasping

MEDiC: Autonomous Surgical Robotic Assistance to Maximizing Exposure for Dissection and Cautery

Manipulating Soft Tissues by Deep Reinforcement Learning for Autonomous Robotic Surgery

Autonomous Tissue Manipulation via Surgical Robot Using Learning Based Model Predictive Control

Self-Supervised Cyclic Diffeomorphic Mapping for Soft Tissue Deformation Recovery in Robotic Surgery Scenes

Real-to-Sim Registration of Deformable Soft Tissue with Position-Based Dynamics for Surgical Robot Autonomy

Real-to-Sim Deformable Object Manipulation: Optimizing Physics Models with Residual Mappings for Robotic Surgery

Sim-To-Real Transfer for Visual Reinforcement Learning of Deformable Object Manipulation for Robot-Assisted Surgery

Reinforcement Learning Based Manipulation Skill Transferring for Robot-assisted Minimally Invasive Surgery.

A New Tensioning Method using Deep Reinforcement Learning for Surgical Pattern Cutting

Deep reinforcement learning in continuous action space for autonomous robotic surgery

Learning surgical skills under the RCM constraint from demonstrations in robot-assisted minimally invasive surgery

Embedded Image-to-Image Translation for Efficient Sim-to-Real Transfer in Learning-based Robot-Assisted Soft Manipulation

Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgery

Monocular tissue reconstruction via remote center motion for robot-assisted minimally invasive surgery

SATR-DL: Improving Surgical Skill Assessment and Task Recognition in Robot-assisted Surgery with Deep Neural Networks

Deep-Learning-Based Force Sensing Method for a Flexible Endovascular Surgery Robot

Latent regression based model predictive control for tissue triangulation

Autonomous countertraction for secure field of view in laparoscopic surgery using deep reinforcement learning