Abstract:Objective Constructing a 3D model from its 2D images, known as 2D-3D reconstruction, is a challenging task. Conventionally, a parametric 3D model such as a statistical shape model (SSM) is deformed by matching the shapes in its 2D images through a series of processes, including calibration, 2D-3D registration, and optimization for nonrigid deformation. To overcome this complicated procedure, a streamlined 2D-3D reconstruction using a single X-ray image is developed in this study. Methods We propose 2D-3D reconstruction of a femur by adopting a deep neural network, where the deformation parameters in the SSM determining the 3D shape of the femur are predicted from a single X-ray image using a deep transfer-learning network. For learning the network from distinct features representing the 3D shape information in the X-ray image, a specific proximal part of the femur from a unique X-ray pose that allows accurate prediction of the 3D femur shape is designated and used to train the network. Then, the corresponding proximal/distal 3D femur model is reconstructed from only the single X-ray image acquired at the designated position. Results Experiments were conducted using actual X-ray images of a femur phantom and X-ray images of a patient's femur derived from computed tomography to verify the proposed method. The average errors of the reconstructed 3D shape of the proximal and distal femurs from the proposed method were 1.20 mm and 1.08 mm in terms of root mean squared point-to-surface distance, respectively. Conclusion The proposed method presents an innovative approach to simplifying the 2D-3D reconstruction using deep neural networks that exhibits performance compatible with the existing methodologies.

3 D reconstruction of femur based on 2 D/3 D registration

Low-dose three-dimensional reconstruction of the femur with unit free-form deformation.

3D Reconstruction of Tibia and Fibula Using One General Model and Two X-ray Images.

Reconstruction of patient-specific 3D bone surface from 2D calibrated fluoroscopic images and point distribution model.

2D-3D Reconstruction of a Femur by Single X-Ray Image Based on Deep Transfer Learning Network

3d Reconstruction Of A Patient-Specific Surface Model Of The Proximal Femur From Calibrated X-Ray Radiographs: A Validation Study

Personalized X-ray Reconstruction of the Proximal Femur Via Intensity-Based Non-Rigid 2D-3D Registration.

3-D reconstruction of a surface model of the proximal femur from digital biplanar radiographs.

Data-driven Method for 3D Axis-symmetric Object Reconstruction from Single Cone-beam Projection Data

A 2D/3D correspondence building method for reconstruction of a patient-specific 3D bone surface model using point distribution models and calibrated X-ray images.

3D femur model reconstruction from biplane X-ray images: a novel method based on Laplacian surface deformation

Patient-Specific 3D Reconstruction of a Complete Lower Extremity from 2D X-rays.

Reconstruction of Patient-Specific 3D Bone Model from Biplanar X-Ray Images and Point Distribution Models

RECONSTRUCTION OF PATIENT-SPECIFIC 3DBONE MODEL FROM BIPLANARX-RAY IMAGES AND POINTDISTRIBUTIONMODELS

3DDX: Bone Surface Reconstruction from a Single Standard-Geometry Radiograph via Dual-Face Depth Estimation

Reconstruction of patient-specific femurs using X-ray and sparse CT images

3D Reconstruction of Marrow Cavities in Proximal Femurs Based on X- Ray Films

A System for 3-D Reconstruction of A Patient-Specific Surface Model from Calibrated X-ray Images

Automatic Extraction Of Proximal Femur Contours From Calibrated X-Ray Images Using 3d Statistical Models: An In Vitro Study

Estimation of 3D Pose of Femurs in Bi-planar Digital Radiographs

Calibration of X-ray Radiographs and Its Feasible Application for 2D/3D Reconstruction of the Proximal Femur