Abstract:Purpose In computer-assisted diagnosis for orthopedic treatment, 3D reconstruction of bones is critical. Traditional 3D imaging technologies like CT and MRI have been proposed, but their high radiation dose and the requirements for lying postures could impact the accuracy of reconstructed bones and diagnosis results. Meanwhile, methods based on bone contours always depend on prior knowledge and lack precise bone segmentation methods. To address these issues, a bone reconstruction method based on multi-views of contours is proposed, as well as a hybrid CNN-Transformer approach for bone contours segmentation. Methods A four-step strategy is introduced including segmenting bone contours from X-ray images, calculating 3D sparse, dense point clouds based on contours, and reconstructing surface. The Trans-DetSeg approach for interest regions detection and bone segmentation is proposed for accurate contours. Besides, the mathematical description of mapping relationships between contours in different views of X-ray images is provided. Then, bone sparse and dense point clouds are generated subsequently. Based on dense point clouds and the power crust method, realistic bone models are reconstructed. Results Evaluated on 301 bone X-ray images and by considering p -value < 0.05, the proposed Trans-Detseg approach performed better with Dice Similarity Coefficient of 0.949 and Hausdorff Distance of 26.17 than three state-of-the-art models. Furthermore, the accuracy of the bone 3D reconstruction was investigated in three tibia cases and the proposed method was verified based on comparisons of results and CT data. It was proved that increased views of X-ray images could reduce the Average Surface Distance and perfect the structure information of reconstructed bones. Conclusion A new method for bone 3D reconstruction based on segmented bone contours on multi-views of X-ray images has been developed. Besides, a hybrid CNN-Transformer approach is introduced to segment bone contours. Evaluations proved the efficiency and accuracy of the proposed bone 3D reconstruction method.

A 3D Reconstruction Method Based on Multi-Views of Contours Segmented with CNN-transformer for Long Bones.

Principle and Realization of Segmenting Contour Series Algorithm in Reverse Engineering Based on X-Ray Computerized Tomography

3D Reconstruction and Augmented Reality Display of Bone Structure Based on Ultrasound Segmentation with Feature-Reweighted U-Net

A New Accurate and Precise 3-D Segmentation Method for Skeletal Structures in Volumetric Ct Data

A 3-D Ultrasound Tomography Method for Bone Morphology Evaluation

A deep learning-based approach to automatic proximal femur segmentation in quantitative CT images

Automatic Extraction Of Proximal Femur Contours From Calibrated X-Ray Images Using 3d Statistical Models: An In Vitro Study

3DDX: Bone Surface Reconstruction from a Single Standard-Geometry Radiograph via Dual-Face Depth Estimation

Alignment, Segmentation and 3-D Reconstruction of Serial Sections Based on Automated Algorithm

Three Dimensional Reconstruction of Bone-Cartilage Transitional Structures Based on Semi-Automatic Registration and Automatic Segmentation of Serial Sections

Spatial-Division Augmented Occupancy Field for Bone Shape Reconstruction from Biplanar X-Rays

A Deep Learning-Based Approach to Extracting Periosteal and Endosteal Contours of Proximal Femur in Quantitative CT Images

RECONSTRUCTION OF PATIENT-SPECIFIC 3DBONE MODEL FROM BIPLANARX-RAY IMAGES AND POINTDISTRIBUTIONMODELS

Automated Detection and Segmentation of Diaphyseal Bone Fragments from Registered C-Arm Images for Long Bone Fracture Reduction

Method for reconstructing three-dimensional body image through two-dimensional X ray image and application thereof

A 2D/3D correspondence building method for reconstruction of a patient-specific 3D bone surface model using point distribution models and calibrated X-ray images.

3D Reconstruction of Tibia and Fibula Using One General Model and Two X-ray Images.

TV-L1 segmentation method and 3D reconstruction technology in orthopaedic surgery

A method framework of semi-automatic knee bone segmentation and reconstruction from computed tomography (CT) images

Towards Cross-Scale Attention and Surface Supervision for Fractured Bone Segmentation in CT

An automatic segmentation algorithm for conglutinated bone fragments in 3D CT images of lower limb fractures based on morphology