A Fourier-enhanced multi-modal 3D small object optical mark recognition and positioning method for percutaneous abdominal puncture surgical navigation

Zezhao Guo,Yanzhong Guo,Zhanfang Zhao

2024-04-13

Abstract:Navigation for thoracoabdominal puncture surgery is used to locate the needle entry point on the patient's body surface. The traditional reflective ball navigation method is difficult to position the needle entry point on the soft, irregular, smooth chest and abdomen. Due to the lack of clear characteristic points on the body surface using structured light technology, it is difficult to identify and locate arbitrary needle insertion points. Based on the high stability and high accuracy requirements of surgical navigation, this paper proposed a novel method, a muti-modal 3D small object medical marker detection method, which identifies the center of a small single ring as the needle insertion point. Moreover, this novel method leverages Fourier transform enhancement technology to augment the dataset, enrich image details, and enhance the network's capability. The method extracts the Region of Interest (ROI) of the feature image from both enhanced and original images, followed by generating a mask map. Subsequently, the point cloud of the ROI from the depth map is obtained through the registration of ROI point cloud contour fitting. In addition, this method employs Tukey loss for optimal precision. The experimental results show this novel method proposed in this paper not only achieves high-precision and high-stability positioning, but also enables the positioning of any needle insertion point.

Computer Vision and Pattern Recognition,Artificial Intelligence,Robotics

What problem does this paper attempt to address?

The problem that this paper attempts to solve is how to accurately locate the needle insertion point in thoracic and abdominal puncture surgery navigation. Traditional methods such as reflective sphere navigation are difficult to accurately locate the needle insertion point on the soft, irregular and smooth thoracic and abdominal surfaces, because these surfaces lack obvious feature points, and it is also difficult to identify and locate arbitrary needle insertion points using structured - light technology. In addition, due to the requirements of high stability and high precision in surgical navigation, existing methods are difficult to meet these needs.

To overcome these problems, the paper proposes a new method - a Fourier - enhanced multi - modal 3D small - target medical marker detection method. This method uses Fourier transform enhancement technology to increase the data set, enrich image details, and improve the network's capabilities. The specific steps include:

1. **Fourier Transform Enhancement**: Use the Fast Fourier Transform (FFT) to enhance image details, making the features in the image more obvious.
2. **Region of Interest Extraction**: Extract the Region of Interest (ROI) from the enhanced image and the original image to generate a mask map.
3. **Point Cloud Generation and Registration**: Obtain the point cloud of the ROI through the depth map, perform point cloud contour fitting and registration, and achieve high - precision and stable single - small - target positioning.
4. **Loss Function Optimization**: Adopt the Tukey loss function to achieve optimal precision.

The experimental results show that this method can not only achieve high - precision and high - stability positioning, but also locate arbitrary needle insertion points, thereby improving the reliability and accuracy of thoracic and abdominal puncture surgery navigation.