Abstract:Purpose: This study aimed to design and evaluate a novel method for the registration of 2D lateral cephalograms and 3D craniofacial cone-beam computed tomography (CBCT) images, providing patient-specific 3D structures from a 2D lateral cephalogram without additional radiation exposure. Methods: We developed a cross-modal deformable registration model based on a deep convolutional neural network. Our approach took advantage of a low-dimensional deformation field encoding and an iterative feedback scheme to infer coarse-to-fine volumetric deformations. In particular, we constructed a statistical subspace of deformation fields and parameterized the nonlinear mapping function from an image pair, consisting of the target 2D lateral cephalogram and the reference volumetric CBCT, to a latent encoding of the deformation field. Instead of the one-shot registration by the learned mapping function, a feedback scheme was introduced to progressively update the reference volumetric image and to infer coarse-to-fine deformations fields, accounting for the shape variations of anatomical structures. A total of 220 clinically obtained CBCTs were used to train and validate the proposed model, among which 120 CBCTs were used to generate a training dataset with 24k paired synthetic lateral cephalograms and CBCTs. The proposed approach was evaluated on the deformable 2D-3D registration of clinically obtained lateral cephalograms and CBCTs from growing and adult orthodontic patients. Results: Strong structural consistencies were observed between the deformed CBCT and the target lateral cephalogram in all criteria. The proposed method achieved state-of-the-art performances with the mean contour deviation of 0.41 +/- 0.12 mm on the anterior cranial base, 0.48 +/- 0.17 mm on the mandible, and 0.35 +/- 0.08 mm on the maxilla, respectively. The mean surface mesh ranged from 0.78 to 0.97 mm on various craniofacial structures, and the LREs ranged from 0.83 to 1.24 mm on the growing datasets regarding 14 landmarks. The proposed iterative feedback scheme handled the structural details and improved the registration. The resultant deformed volumetric image was consistent with the target lateral cephalogram in both 2D projective planes and 3D volumetric space regarding the multicategory craniofacial structures. Conclusions: The results suggest that the deep learning-based 2D-3D registration model enables the deformable alignment of 2D lateral cephalograms and CBCTs and estimates patient-specific 3D craniofacial structures.

Craniofacial Volumetric Image Estimation from a Lateral Cephalogram Using Cross-Dimensional Discrete Embedding Mapping.

Towards Semantically-Consistent Deformable 2D-3D Registration for 3D Craniofacial Structure Estimation from A Single-View Lateral Cephalometric Radiograph

Spectral Embedding Approximation and Descriptor Learning for Craniofacial Volumetric Image Correspondence

Deformable Registration of Lateral Cephalogram and Cone-Beam Computed Tomography Image

Volumetric Reconstruction Of Craniofacial Structures From 2d Lateral Cephalograms By Regression Forest

3D Volume Reconstruction from Single Lateral X-Ray Image via Cross-Modal Discrete Embedding Transition.

CephalFormer: Incorporating Global Structure Constraint into Visual Features for General Cephalometric Landmark Detection

Temporal Consistent 2D-3D Registration of Lateral Cephalograms and Cone-Beam Computed Tomography Images.

Non-Rigid 2D-3D Registration Using Convolutional Autoencoders

Localization of Craniomaxillofacial Landmarks on CBCT Images Using 3D Mask R-CNN and Local Dependency Learning

A cross-temporal multimodal fusion system based on deep learning for orthodontic monitoring

Oral-3Dv2: 3D Oral Reconstruction from Panoramic X-Ray Imaging with Implicit Neural Representation

DMCVR: Morphology-Guided Diffusion Model for 3D Cardiac Volume Reconstruction

From Skulls to Faces: A Deep Generative Framework for Realistic 3D Craniofacial Reconstruction.

Deep Learning–Based Facial and Skeletal Transformations for Surgical Planning

Creating high-resolution 3D cranial implant geometry using deep learning techniques

Deep Volumetric Descriptor Learning for Dense Correspondence of Cone-Beam Computed Tomography Via Spectral Maps

Image fusion in craniofacial virtual reality modeling based on CT and 3dMD photogrammetry

Latent Disentanglement in Mesh Variational Autoencoders Improves the Diagnosis of Craniofacial Syndromes and Aids Surgical Planning

Deep Simulation of Facial Appearance Changes Following Craniomaxillofacial Bony Movements in Orthognathic Surgical Planning

An MRI-only Three-dimensional Cephalometry Protocol based on the Integrated and Modular Architecture of the Human Head