Abstract:Objective Constructing a 3D model from its 2D images, known as 2D-3D reconstruction, is a challenging task. Conventionally, a parametric 3D model such as a statistical shape model (SSM) is deformed by matching the shapes in its 2D images through a series of processes, including calibration, 2D-3D registration, and optimization for nonrigid deformation. To overcome this complicated procedure, a streamlined 2D-3D reconstruction using a single X-ray image is developed in this study. Methods We propose 2D-3D reconstruction of a femur by adopting a deep neural network, where the deformation parameters in the SSM determining the 3D shape of the femur are predicted from a single X-ray image using a deep transfer-learning network. For learning the network from distinct features representing the 3D shape information in the X-ray image, a specific proximal part of the femur from a unique X-ray pose that allows accurate prediction of the 3D femur shape is designated and used to train the network. Then, the corresponding proximal/distal 3D femur model is reconstructed from only the single X-ray image acquired at the designated position. Results Experiments were conducted using actual X-ray images of a femur phantom and X-ray images of a patient's femur derived from computed tomography to verify the proposed method. The average errors of the reconstructed 3D shape of the proximal and distal femurs from the proposed method were 1.20 mm and 1.08 mm in terms of root mean squared point-to-surface distance, respectively. Conclusion The proposed method presents an innovative approach to simplifying the 2D-3D reconstruction using deep neural networks that exhibits performance compatible with the existing methodologies.

Low-dose three-dimensional reconstruction of the femur with unit free-form deformation.

3 D reconstruction of femur based on 2 D/3 D registration

Patient-Specific 3D Reconstruction of a Complete Lower Extremity from 2D X-rays.

3D Reconstruction of Tibia and Fibula Using One General Model and Two X-ray Images.

Data-driven Method for 3D Axis-symmetric Object Reconstruction from Single Cone-beam Projection Data

2D-3D Reconstruction of a Femur by Single X-Ray Image Based on Deep Transfer Learning Network

3D femur model reconstruction from biplane X-ray images: a novel method based on Laplacian surface deformation

Reconstruction of patient-specific femurs using X-ray and sparse CT images

Reconstruction of patient-specific 3D bone surface from 2D calibrated fluoroscopic images and point distribution model.

Personalized X-ray Reconstruction of the Proximal Femur Via Intensity-Based Non-Rigid 2D-3D Registration.

3DDX: Bone Surface Reconstruction from a Single Standard-Geometry Radiograph via Dual-Face Depth Estimation

An Integrated Approach for Reconstructing a Surface Model of the Proximal Femur from Sparse Input Data and a Multi-Resolution Point Distribution Model: an in Vitro Study.

3d Reconstruction Of A Patient-Specific Surface Model Of The Proximal Femur From Calibrated X-Ray Radiographs: A Validation Study

An Automatic Regularization Method: An Application for 3-D X-Ray Micro-CT Reconstruction Using Sparse Data

3-D reconstruction of a surface model of the proximal femur from digital biplanar radiographs.

A 2D/3D correspondence building method for reconstruction of a patient-specific 3D bone surface model using point distribution models and calibrated X-ray images.

Fully Automatic Reconstruction of Personalized 3D Volumes of the Proximal Femur from 2D X-ray Images.

Reconstruction of Patient-Specific 3D Bone Model from Biplanar X-Ray Images and Point Distribution Models

A System for 3-D Reconstruction of A Patient-Specific Surface Model from Calibrated X-ray Images

ATLAS-BASED RECONSTRUCTION OF 3D VOLUMES OF LOWER EXTREMITY FROM 2D-CALIBRATED RADIOGRAPH IMAGES

Statistical Shape and Deformation Models Based 2D–3D Reconstruction