Abstract:Purpose In computer-assisted diagnosis for orthopedic treatment, 3D reconstruction of bones is critical. Traditional 3D imaging technologies like CT and MRI have been proposed, but their high radiation dose and the requirements for lying postures could impact the accuracy of reconstructed bones and diagnosis results. Meanwhile, methods based on bone contours always depend on prior knowledge and lack precise bone segmentation methods. To address these issues, a bone reconstruction method based on multi-views of contours is proposed, as well as a hybrid CNN-Transformer approach for bone contours segmentation. Methods A four-step strategy is introduced including segmenting bone contours from X-ray images, calculating 3D sparse, dense point clouds based on contours, and reconstructing surface. The Trans-DetSeg approach for interest regions detection and bone segmentation is proposed for accurate contours. Besides, the mathematical description of mapping relationships between contours in different views of X-ray images is provided. Then, bone sparse and dense point clouds are generated subsequently. Based on dense point clouds and the power crust method, realistic bone models are reconstructed. Results Evaluated on 301 bone X-ray images and by considering p -value < 0.05, the proposed Trans-Detseg approach performed better with Dice Similarity Coefficient of 0.949 and Hausdorff Distance of 26.17 than three state-of-the-art models. Furthermore, the accuracy of the bone 3D reconstruction was investigated in three tibia cases and the proposed method was verified based on comparisons of results and CT data. It was proved that increased views of X-ray images could reduce the Average Surface Distance and perfect the structure information of reconstructed bones. Conclusion A new method for bone 3D reconstruction based on segmented bone contours on multi-views of X-ray images has been developed. Besides, a hybrid CNN-Transformer approach is introduced to segment bone contours. Evaluations proved the efficiency and accuracy of the proposed bone 3D reconstruction method.

Automatic Extraction Of Proximal Femur Contours From Calibrated X-Ray Images Using 3d Statistical Models: An In Vitro Study

Automatic Extraction of Proximal Femur Contours from Calibrated X-Ray Images Using 3D Statistical Models

Automatic Extraction of Femur Contours from Calibrated X-Ray Images Using Statistical Information

Automatic Extraction of Femur Contours from Calibrated Fluoroscopic Images

Automatic Extraction of Femur Contours from Calibrated X-Ray Images: A Bayesian Inference Approach

Automatic Reconstruction Of A Patient-Specific Surface Model Of A Proximal Femur From Calibrated X-Ray Images Via Bayesian Filters

Personalized X-ray Reconstruction of the Proximal Femur Via Intensity-Based Non-Rigid 2D-3D Registration.

Statistical model-based segmentation of the proximal femur in digital antero-posterior (AP) pelvic radiographs

Full-length Radiograph Based Automatic Musculoskeletal Modeling Using Convolutional Neural Network

Personalized X-ray Reconstruction of the Proximal Femur Via a New Control Point-based 2D-3D Registration and Residual Complexity Minimization.

3d Reconstruction Of A Patient-Specific Surface Model Of The Proximal Femur From Calibrated X-Ray Radiographs: A Validation Study

Calibration of X-ray Radiographs and Its Feasible Application for 2D/3D Reconstruction of the Proximal Femur

A 3D Reconstruction Method Based on Multi-Views of Contours Segmented with CNN-transformer for Long Bones.

Automated Detection and Segmentation of Diaphyseal Bone Fragments from Registered C-Arm Images for Long Bone Fracture Reduction

3 D reconstruction of femur based on 2 D/3 D registration

Reconstruction of patient-specific 3D bone surface from 2D calibrated fluoroscopic images and point distribution model.

A Deep Learning-Based Approach to Extracting Periosteal and Endosteal Contours of Proximal Femur in Quantitative CT Images

Patient-Specific 3D Reconstruction of a Complete Lower Extremity from 2D X-rays.

Automated Detection and Segmentation of Cylindrical Fragments from Calibrated C-arm Images for Long Bone Fracture Reduction

Particle Filter Based Automatic Reconstruction Of A Patient-Specific Surface Model Of A Proximal Femur From Calibrated X-Ray Images For Surgical Navigation

A Deep Learning-Based Method for Automatic Segmentation of Proximal Femur from Quantitative Computed Tomography Images