Abstract:3D reconstruction of medical imaging from 2D images has become an increasingly interesting topic with the development of deep learning models in recent years. Previous studies in 3D reconstruction from limited X-ray images mainly rely on learning from paired 2D and 3D images, where the reconstruction quality relies on the scale and variation of collected data. This has brought significant challenges in the collection of training data, as only a tiny fraction of patients take two types of radiation examinations in the same period. Although simulation from higher-dimension images could solve this problem, the variance between real and simulated data could bring great uncertainty at the same time. In oral reconstruction, the situation becomes more challenging as only a single panoramic X-ray image is available, where models need to infer the curved shape by prior individual knowledge. To overcome these limitations, we propose Oral-3Dv2 to solve this cross-dimension translation problem in dental healthcare by learning solely on projection information, i.e., the projection image and trajectory of the X-ray tube. Our model learns to represent the 3D oral structure in an implicit way by mapping 2D coordinates into density values of voxels in the 3D space. To improve efficiency and effectiveness, we utilize a multi-head model that predicts a bunch of voxel values in 3D space simultaneously from a 2D coordinate in the axial plane and the dynamic sampling strategy to refine details of the density distribution in the reconstruction result. Extensive experiments in simulated and real data show that our model significantly outperforms existing state-of-the-art models without learning from paired images or prior individual knowledge. To the best of our knowledge, this is the first work of a non-adversarial-learning-based model in 3D radiology reconstruction from a single panoramic X-ray image.

NeBLa: Neural Beer-Lambert for 3D Reconstruction of Oral Structures from Panoramic Radiographs

[Oral Panorama Reconstruction Method Based on Pre-Segmentation and Bezier Function].

Oral-3Dv2: 3D Oral Reconstruction from Panoramic X-Ray Imaging with Implicit Neural Representation

Oral-3D: Reconstructing the 3D Bone Structure of Oral Cavity from 2D Panoramic X-ray

3DPX: Progressive 2D-to-3D Oral Image Reconstruction with Hybrid MLP-CNN Networks

3DPX: Single Panoramic X-ray Analysis Guided by 3D Oral Structure Reconstruction

3D Teeth Reconstruction from Panoramic Radiographs using Neural Implicit Functions

TeethDreamer: 3D Teeth Reconstruction from Five Intra-oral Photographs

OralViewer: 3D Demonstration of Dental Surgeries for Patient Education with Oral Cavity Reconstruction from a 2D Panoramic X-ray

PX2Tooth: Reconstructing the 3D Point Cloud Teeth from a Single Panoramic X-ray

Artificial Intelligence for 3D Reconstruction from 2D Panoramic X-rays to Assess Maxillary Impacted Canines

Automatic 3D Teeth Reconstruction from Five Intra-Oral Photos Using Parametric Teeth Model.

X2Teeth: 3D Teeth Reconstruction from a Single Panoramic Radiograph

Structure-Aware Sparse-View X-ray 3D Reconstruction

Towards Semantically-Consistent Deformable 2D-3D Registration for 3D Craniofacial Structure Estimation from A Single-View Lateral Cephalometric Radiograph

Benchmarking Encoder-Decoder Architectures for Biplanar X-ray to 3D Shape Reconstruction

Automatic 3D Registration of Dental CBCT and Face Scan Data using 2D Projection Images

DTR-Net: Dual-space 3D Tooth Model Reconstruction from Panoramic X-ray Images

Novel Procedure for Automatic Registration between Cone-Beam Computed Tomography and Intraoral Scan Data Supported with 3D Segmentation

3D reconstruction based on compressed-sensing (CS)-based framework by using a dental panoramic detector

Neural Rendering for Stereo 3D Reconstruction of Deformable Tissues in Robotic Surgery