Three-dimensional Morphological Reconstruction of Millimeter-Scale Soft Continuum Robots based on Dual-Stereo-Vision

Tian-Ao Ren,Wenyan Liu,Tao Zhang,Lei Zhao,Hongliang Ren,Jiewen Lai

2024-08-16

Abstract:Continuum robots can be miniaturized to just a few millimeters in diameter. Among these, notched tubular continuum robots (NTCR) show great potential in many delicate applications. Existing works in robotic modeling focus on kinematics and dynamics but still face challenges in reproducing the robot's morphology -- a significant factor that can expand the research landscape of continuum robots, especially for those with asymmetric continuum structures. This paper proposes a dual stereo vision-based method for the three-dimensional morphological reconstruction of millimeter-scale NTCRs. The method employs two oppositely located stationary binocular cameras to capture the point cloud of the NTCR, then utilizes predefined geometry as a reference for the KD tree method to relocate the capture point clouds, resulting in a morphologically correct NTCR despite the low-quality raw point cloud collection. The method has been proved feasible for an NTCR with a 3.5 mm diameter, capturing 14 out of 16 notch features, with the measurements generally centered around the standard of 1.5 mm, demonstrating the capability of revealing morphological details. Our proposed method paves the way for 3D morphological reconstruction of millimeter-scale soft robots for further self-modeling study.

Robotics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is that the existing soft - robot modeling research mainly focuses on kinematics and dynamics, but still faces challenges in reconstructing the morphology of robots, especially for robots with asymmetric continuous structures. Specifically, the paper proposes a method based on binocular stereo vision for the three - dimensional morphological reconstruction of millimeter - scale notched tubular continuous robots (NTCR). This method captures the point - cloud data of NTCR by using two binocular cameras with fixed relative positions, and uses predefined geometric shapes as references. By re - locating the captured point - cloud through the KD - tree method, it can also achieve the correct morphological reconstruction of NTCR even in the case of low - quality original point - cloud acquisition. The paper demonstrates the effectiveness of this method for NTCR with a diameter of 3.5 millimeters. It can capture 14 out of 16 groove features, and the measured values are mostly concentrated near the 1.5 - millimeter standard, proving its ability to reveal morphological details. This method paves the way for the 3D morphological reconstruction and further self - modeling research of millimeter - scale soft robots.