Abstract:Objective Constructing a 3D model from its 2D images, known as 2D-3D reconstruction, is a challenging task. Conventionally, a parametric 3D model such as a statistical shape model (SSM) is deformed by matching the shapes in its 2D images through a series of processes, including calibration, 2D-3D registration, and optimization for nonrigid deformation. To overcome this complicated procedure, a streamlined 2D-3D reconstruction using a single X-ray image is developed in this study. Methods We propose 2D-3D reconstruction of a femur by adopting a deep neural network, where the deformation parameters in the SSM determining the 3D shape of the femur are predicted from a single X-ray image using a deep transfer-learning network. For learning the network from distinct features representing the 3D shape information in the X-ray image, a specific proximal part of the femur from a unique X-ray pose that allows accurate prediction of the 3D femur shape is designated and used to train the network. Then, the corresponding proximal/distal 3D femur model is reconstructed from only the single X-ray image acquired at the designated position. Results Experiments were conducted using actual X-ray images of a femur phantom and X-ray images of a patient's femur derived from computed tomography to verify the proposed method. The average errors of the reconstructed 3D shape of the proximal and distal femurs from the proposed method were 1.20 mm and 1.08 mm in terms of root mean squared point-to-surface distance, respectively. Conclusion The proposed method presents an innovative approach to simplifying the 2D-3D reconstruction using deep neural networks that exhibits performance compatible with the existing methodologies.

Personalized X-ray Reconstruction of the Proximal Femur Via Intensity-Based Non-Rigid 2D-3D Registration.

Personalized X-ray Reconstruction of the Proximal Femur Via a New Control Point-based 2D-3D Registration and Residual Complexity Minimization.

2D-3D Regularized Deformable B-Spline Registration: Application to the Proximal Femur.

2D-3D Reconstruction of a Femur by Single X-Ray Image Based on Deep Transfer Learning Network

3 D reconstruction of femur based on 2 D/3 D registration

Automatic Extraction Of Proximal Femur Contours From Calibrated X-Ray Images Using 3d Statistical Models: An In Vitro Study

Patient-Specific 3D Reconstruction of a Complete Lower Extremity from 2D X-rays.

Automatic Extraction of Proximal Femur Contours from Calibrated X-Ray Images Using 3D Statistical Models

3d Volumetric Intensity Reconsturction From 2d X-Ray Images Using Partial Least Squares Regression

Reconstruction of Patient-Specific 3D Bone Model from Biplanar X-Ray Images and Point Distribution Models

3d Reconstruction Of A Patient-Specific Surface Model Of The Proximal Femur From Calibrated X-Ray Radiographs: A Validation Study

Atlas-Based 3d Intensity Volume Reconstruction Of Musculoskeletal Structures In The Lower Extremity From 2d Calibrated X-Ray Images

Fully Automatic Reconstruction of Personalized 3D Volumes of the Proximal Femur from 2D X-ray Images.

Low-dose three-dimensional reconstruction of the femur with unit free-form deformation.

Automatic Reconstruction Of A Patient-Specific Surface Model Of A Proximal Femur From Calibrated X-Ray Images Via Bayesian Filters

Calibration of X-ray Radiographs and Its Feasible Application for 2D/3D Reconstruction of the Proximal Femur

Automatic Extraction of Femur Contours from Calibrated X-Ray Images Using Statistical Information

Statistical Deformable Model-Based Reconstruction of a Patient-Specific Surface Model from Single Standard X-ray Radiograph

Reconstruction of patient-specific 3D bone surface from 2D calibrated fluoroscopic images and point distribution model.

Reconstruction of patient-specific femurs using X-ray and sparse CT images

3D Reconstruction of Tibia and Fibula Using One General Model and Two X-ray Images.