Abstract:In the field of medical applications, precise localization of medical instruments and bone structures is crucial to ensure computer-assisted surgical interventions. In orthopedic surgery, existing devices typically rely on stereoscopic vision. Their purpose is to aid the surgeon in screw fixation of prostheses or bone removal. This article addresses the challenge of localizing a rigid object consisting of randomly arranged planar markers using a single camera. This approach is especially vital in medical situations where accurate object alignment relative to a camera is necessary at distances ranging from 80 cm to 120 cm. In addition, the size limitation of a few tens of centimeters ensures that the resulting locator does not obstruct the work area. This rigid locator consists of a solid at the surface of which a set of plane markers (ArUco) are glued. These plane markers are randomly distributed over the surface in order to systematically have a minimum of two visible markers whatever the orientation of the locator. The calibration of the locator involves finding the relative positions between the individual planar elements and is based on a bundle adjustment approach. One of the main and known difficulties associated with planar markers is the problem of pose ambiguity. To solve this problem, our method lies in the formulation of an efficient initial solution for the optimization step. After the calibration step, the reached positioning uncertainties of the locator are better than two-tenth of a cubic millimeter and one-tenth of a degree, regardless of the orientation of the locator in space. To assess the proposed method, the locator is rigidly attached to a stylus of about twenty centimeters length. Thanks to this approach, the tip of this stylus seen by a 16.1 megapixel camera at a distance of about 1 m is localized in real time in a cube lower than 1 mm side. A surface registration application is proposed by using the stylus on an artificial scapula.

Tracking endoscopic instruments without localizer: image analysis-based approach

Tracking endoscopic instruments without a localizer: a shape-analysis-based approach

An automatic calibration algorithm for endoscopic structured light sensors in cylindrical environment

An integrated approach to endoscopic instrument tracking for augmented reality applications in surgical simulation training

Cognitive tracking of surgical instruments based on stereo vision and depth sensing

An adaptive and fully automatic method for estimating the 3D position of bendable instruments using endoscopic images

Combined 2D and 3D tracking of surgical instruments for minimally invasive and robotic-assisted surgery

Endoscope As A Tracking Tool For Computer Assisted Minimally Invasive Ventral Spine Surgeries

An EM-Tracked Approach for Calibrating the 3D Pose of Flexible Endoscopes

Vision-Based Real-Time Tracking of Surgical Instruments in Robot-Assisted Laparoscopic Surgery

Deep Learning Assisted Robotic Magnetic Anchored and Guided Endoscope for Real-Time Instrument Tracking

Investigating keypoint descriptors for camera relocalization in endoscopy surgery

Surgical instrument recognition and calibration for optical tracking system.

Robotic Endoscope Control via Autonomous Instrument Tracking

High-accuracy 3D locators tracking in real time using monocular vision

Endoscope FOV Autonomous Tracking Method for Robot-Assisted Surgery Considering Pose Control, Hand–Eye Coordination, and Image Definition

Comparison of Depth Estimation Setups from Stereo Endoscopy and Optical Tracking for Point Measurements

A Surgeon Preference-Guided Autonomous Instrument Tracking Method With a Robotic Flexible Endoscope Based on dVRK Platform

Next-generation Surgical Navigation: Marker-less Multi-view 6DoF Pose Estimation of Surgical Instruments

Real-time Surgical Tool Tracking and Pose Estimation Using a Hybrid Cylindrical Marker.

Markerless Inside-Out Tracking for Interventional Applications