Abstract:Purpose In computer-assisted diagnosis for orthopedic treatment, 3D reconstruction of bones is critical. Traditional 3D imaging technologies like CT and MRI have been proposed, but their high radiation dose and the requirements for lying postures could impact the accuracy of reconstructed bones and diagnosis results. Meanwhile, methods based on bone contours always depend on prior knowledge and lack precise bone segmentation methods. To address these issues, a bone reconstruction method based on multi-views of contours is proposed, as well as a hybrid CNN-Transformer approach for bone contours segmentation. Methods A four-step strategy is introduced including segmenting bone contours from X-ray images, calculating 3D sparse, dense point clouds based on contours, and reconstructing surface. The Trans-DetSeg approach for interest regions detection and bone segmentation is proposed for accurate contours. Besides, the mathematical description of mapping relationships between contours in different views of X-ray images is provided. Then, bone sparse and dense point clouds are generated subsequently. Based on dense point clouds and the power crust method, realistic bone models are reconstructed. Results Evaluated on 301 bone X-ray images and by considering p -value < 0.05, the proposed Trans-Detseg approach performed better with Dice Similarity Coefficient of 0.949 and Hausdorff Distance of 26.17 than three state-of-the-art models. Furthermore, the accuracy of the bone 3D reconstruction was investigated in three tibia cases and the proposed method was verified based on comparisons of results and CT data. It was proved that increased views of X-ray images could reduce the Average Surface Distance and perfect the structure information of reconstructed bones. Conclusion A new method for bone 3D reconstruction based on segmented bone contours on multi-views of X-ray images has been developed. Besides, a hybrid CNN-Transformer approach is introduced to segment bone contours. Evaluations proved the efficiency and accuracy of the proposed bone 3D reconstruction method.

Automatic Extraction of Proximal Femur Contours from Calibrated X-Ray Images Using 3D Statistical Models

Automatic Extraction of Femur Contours from Calibrated X-Ray Images Using Statistical Information

Automatic Extraction of Femur Contours from Calibrated Fluoroscopic Images

Automatic Extraction of Femur Contours from Calibrated X-Ray Images: A Bayesian Inference Approach

Automatic Extraction Of Proximal Femur Contours From Calibrated X-Ray Images Using 3d Statistical Models: An In Vitro Study

Automatic Reconstruction Of A Patient-Specific Surface Model Of A Proximal Femur From Calibrated X-Ray Images Via Bayesian Filters

Personalized X-ray Reconstruction of the Proximal Femur Via Intensity-Based Non-Rigid 2D-3D Registration.

Personalized X-ray Reconstruction of the Proximal Femur Via a New Control Point-based 2D-3D Registration and Residual Complexity Minimization.

Full-length Radiograph Based Automatic Musculoskeletal Modeling Using Convolutional Neural Network

2D-3D Reconstruction of a Femur by Single X-Ray Image Based on Deep Transfer Learning Network

A deep learning-based approach to automatic proximal femur segmentation in quantitative CT images

Fully Automatic Determination of Morphological Parameters of Proximal Femur from Calibrated Fluoroscopic Images Through Particle Filtering.

A Deep Learning-Based Approach to Extracting Periosteal and Endosteal Contours of Proximal Femur in Quantitative CT Images

Automated Detection and Segmentation of Diaphyseal Bone Fragments from Registered C-Arm Images for Long Bone Fracture Reduction

A 3D Reconstruction Method Based on Multi-Views of Contours Segmented with CNN-transformer for Long Bones.

Reconstruction of Patient-Specific 3D Bone Model from Biplanar X-Ray Images and Point Distribution Models

Statistical model-based segmentation of the proximal femur in digital antero-posterior (AP) pelvic radiographs

Patient-Specific 3D Reconstruction of a Complete Lower Extremity from 2D X-rays.

3 D reconstruction of femur based on 2 D/3 D registration

A Deep Learning-Based Method for Automatic Segmentation of Proximal Femur from Quantitative Computed Tomography Images

2D-3D Regularized Deformable B-Spline Registration: Application to the Proximal Femur.