Abstract:Purpose: Fluoroscopy is the standard imaging modality used to guide hip surgery and is therefore a natural sensor for computer-assisted navigation. In order to efficiently solve the complex registration problems presented during navigation, human-assisted annotations of the intraoperative image are typically required. This manual initialization interferes with the surgical workflow and diminishes any advantages gained from navigation. In this paper, we propose a method for fully automatic registration using anatomical annotations produced by a neural network. Methods: Neural networks are trained to simultaneously segment anatomy and identify landmarks in fluoroscopy. Training data are obtained using a computationally intensive, intraoperatively incompatible, 2D/3D registration of the pelvis and each femur. Ground truth 2D segmentation labels and anatomical landmark locations are established using projected 3D annotations. Intraoperative registration couples a traditional intensity-based strategy with annotations inferred by the network and requires no human assistance. Results: Ground truth segmentation labels and anatomical landmarks were obtained in 366 fluoroscopic images across 6 cadaveric specimens. In a leave-one-subject-out experiment, networks trained on these data obtained mean dice coefficients for left and right hemipelves, left and right femurs of 0.86, 0.87, 0.90, and 0.84, respectively. The mean 2D landmark localization error was 5.0 mm. The pelvis was registered within [Formula: see text] for 86% of the images when using the proposed intraoperative approach with an average runtime of 7 s. In comparison, an intensity-only approach without manual initialization registered the pelvis to [Formula: see text] in 18% of images. Conclusions: We have created the first accurately annotated, non-synthetic, dataset of hip fluoroscopy. By using these annotations as training data for neural networks, state-of-the-art performance in fluoroscopic segmentation and landmark localization was achieved. Integrating these annotations allows for a robust, fully automatic, and efficient intraoperative registration during fluoroscopic navigation of the hip.

Fiducial-Free 2D/3D Registration for Robot-Assisted Femoroplasty

Multi-Body 3D-2D Registration for Robot-Assisted Joint Reduction: Preclinical Evaluation in the Ankle Syndesmosis

Fast and Automatic Periacetabular Osteotomy Fragment Pose Estimation Using Intraoperatively Implanted Fiducials and Single-View Fluoroscopy

Open-source navigation system for tracking dissociated parts with multi-registration

Evaluation of an intensity-based algorithm for 2D/3D registration of natural knee videofluoroscopy data

Spatial Detection of the Shafts of Fractured Femur for Image-Guided Robotic Surgery

Automatic annotation of hip anatomy in fluoroscopy for robust and efficient 2D/3D registration

Estimation of 3D Pose of Femurs in Bi-planar Digital Radiographs

Personalized X-ray Reconstruction of the Proximal Femur Via a New Control Point-based 2D-3D Registration and Residual Complexity Minimization.

Robust Automatic Detection and Removal of Fiducial Projections in Fluoroscopy Images: an Integrated Solution

Personalized X-ray Reconstruction of the Proximal Femur Via Intensity-Based Non-Rigid 2D-3D Registration.

A Motion Compensation Method for Bi-Plane Robot-Assisted Internal Fixation Surgery of a Femur Neck Fracture.

A Noninvasive Calibration-Free and Model-Free Surgical Robot for Automatic Fracture Reduction

A multi-view interactive virtual-physical registration method for mixed reality based surgical navigation in pelvic and acetabular fracture fixation

2D/3D registration and motion tracking for surgical interventions

Calibration and Registration of a Freehand Video-Guided Surgical Drill for Orthopaedic Trauma

Accurate and Reliable Pose Recovery of Distal Locking Holes in Computer-Assisted Intra-Medullary Nailing of Femoral Shaft Fractures: a Preliminary Study.

Computerized Fluoroscopy with Zero-Dose Image Updates for Minimally Invasive Femoral Diaphyseal Fracture Reduction

Fluoroscopic Navigation for a Surgical Robotic System Including a Continuum Manipulator

A Marker-Free 2D Image-Guided Method for Robot-Assisted Fracture Reduction Surgery

Image Guidance for Robot-Assisted Ankle Fracture Repair