Orientation Matters: 6-DoF Autonomous Camera Movement for Minimally Invasive Surgery

Alaa Eldin Abdelaal,Nancy Hong,Apeksha Avinash,Divya Budihal,Maram Sakr,Gregory D. Hager,Septimiu E. Salcudean

DOI: https://doi.org/10.48550/arXiv.2012.02836

2020-12-05

Abstract:We propose a new method for six-degree-of-freedom (6-DoF) autonomous camera movement for minimally invasive surgery, which, unlike previous methods, takes into account both the position and orientation information from structures in the surgical scene. In addition to locating the camera for a good view of the manipulated object, our autonomous camera takes into account workspace constraints, including the horizon and safety constraints. We developed a simulation environment to test our method on the "wire chaser" surgical training task from validated training curricula in conventional laparoscopy and robot-assisted surgery. Furthermore, we propose, for the first time, the application of the proposed autonomous camera method in video-based surgical skill assessment, an area where videos are typically recorded using fixed cameras. In a study with N=30 human subjects, we show that video examination of the autonomous camera view as it tracks the ring motion over the wire leads to more accurate user error (ring touching the wire) detection than when using a fixed camera view, or camera movement with a fixed orientation. Our preliminary work suggests that there are potential benefits to autonomous camera positioning informed by scene orientation, and this can direct designers of automated endoscopes and surgical robotic systems, especially when using chip-on-tip cameras that can be wristed for 6-DoF motion.

Robotics

What problem does this paper attempt to address?

This paper attempts to address the problem of how to achieve six degrees of freedom (6-DoF) autonomous camera motion in minimally invasive surgery (MIS) to provide better visual feedback. Specifically, existing autonomous camera methods mainly rely on positional information while ignoring the orientation information of structures in the scene. This leads to situations where the camera cannot provide the optimal view, affecting the accuracy of surgical operations and video recordings.

To overcome this issue, the authors propose a new autonomous camera method that considers both positional and orientation information of structures in the scene. In this way, the camera can better align with the objects of interest and adapt to workspace constraints, including horizon and safety constraints. Additionally, the authors explore the potential of applying this autonomous camera method to video-based surgical skill assessment to improve the accuracy of the evaluation.

In summary, the main contributions of this paper include:
1. Proposing a new autonomous camera method that combines positional and orientation information.
2. Implementing this autonomous camera method in a simulated environment and testing its performance in a "line-chasing" surgical training task.
3. For the first time, proposing the application of the autonomous camera method to video-based surgical skill assessment and validating its effectiveness through user studies.