Abstract:Purpose In computer-assisted diagnosis for orthopedic treatment, 3D reconstruction of bones is critical. Traditional 3D imaging technologies like CT and MRI have been proposed, but their high radiation dose and the requirements for lying postures could impact the accuracy of reconstructed bones and diagnosis results. Meanwhile, methods based on bone contours always depend on prior knowledge and lack precise bone segmentation methods. To address these issues, a bone reconstruction method based on multi-views of contours is proposed, as well as a hybrid CNN-Transformer approach for bone contours segmentation. Methods A four-step strategy is introduced including segmenting bone contours from X-ray images, calculating 3D sparse, dense point clouds based on contours, and reconstructing surface. The Trans-DetSeg approach for interest regions detection and bone segmentation is proposed for accurate contours. Besides, the mathematical description of mapping relationships between contours in different views of X-ray images is provided. Then, bone sparse and dense point clouds are generated subsequently. Based on dense point clouds and the power crust method, realistic bone models are reconstructed. Results Evaluated on 301 bone X-ray images and by considering p -value < 0.05, the proposed Trans-Detseg approach performed better with Dice Similarity Coefficient of 0.949 and Hausdorff Distance of 26.17 than three state-of-the-art models. Furthermore, the accuracy of the bone 3D reconstruction was investigated in three tibia cases and the proposed method was verified based on comparisons of results and CT data. It was proved that increased views of X-ray images could reduce the Average Surface Distance and perfect the structure information of reconstructed bones. Conclusion A new method for bone 3D reconstruction based on segmented bone contours on multi-views of X-ray images has been developed. Besides, a hybrid CNN-Transformer approach is introduced to segment bone contours. Evaluations proved the efficiency and accuracy of the proposed bone 3D reconstruction method.

Study on the Methods for Orientation of Structures on the Sectional Image based on 3D Model

3D Reconstruction Based on Image Segmentation

Principle and Realization of Segmenting Contour Series Algorithm in Reverse Engineering Based on X-Ray Computerized Tomography

Study of Medical Image Interactive Orientation Based on VTK

Alignment, Segmentation and 3-D Reconstruction of Serial Sections Based on Automated Algorithm

Method and Implementation for Segmentation of Sulci and Gyri on Cross-Section Images Based on 3D Brain Model

Research on Virtual Three Dimensional Reconstruction System for Medical Slices Image

3D Construction of the Human Spine Cervical Segment and Statistical Analysis of Scientific Measurement

Study on 3D Reconstruction of Medical Image and Orthographic Views

Three-Dimensional Structure Measurement And Optimization Method Of Indoor Scene Based On Single Image

A System of Three-dimensional Reconstruction Based on CT Images

Reconstrucion and Visualization of 3D Surface Model from Serial-Sectioned Contour Points

A study on three-dimensional visualization of craniofacial anatomic structures

A 3D Reconstruction Method Based on Multi-Views of Contours Segmented with CNN-transformer for Long Bones.

Converting sectional views to three orthographic views to reconstruct 3D models

Study and Development on Three -Dimensional Analysis Software for Microscope

Surface rendering of section planes based on brain volume data of Chinese virtual human

Three Dimensional Reconstruction of Bone-Cartilage Transitional Structures Based on Semi-Automatic Registration and Automatic Segmentation of Serial Sections

Three-Dimensional Reconstruction and Analysis of Human Central Sulcus Based on Visualization Toolkit

AN COMPUTERIZED 3D RECONSTRUCTION METHOD BASED ON RAT'S CERVICAL CORD SERIAL SECTIONS

3D Structure Surface Modelling from Volumetric CT Images