Abstract:This paper presents a fully automatic registration method of dental cone-beam computed tomography (CBCT) and face scan data. It can be used for a digital platform of 3D jaw-teeth-face models in a variety of applications, including 3D digital treatment planning and orthognathic surgery. Difficulties in accurately merging facial scans and CBCT images are due to the different image acquisition methods and limited area of correspondence between the two facial surfaces. In addition, it is difficult to use machine learning techniques because they use face-related 3D medical data with radiation exposure, which are difficult to obtain for training. The proposed method addresses these problems by reusing an existing machine-learning-based 2D landmark detection algorithm in an open-source library and developing a novel mathematical algorithm that identifies paired 3D landmarks from knowledge of the corresponding 2D landmarks. A main contribution of this study is that the proposed method does not require annotated training data of facial landmarks because it uses a pre-trained facial landmark detection algorithm that is known to be robust and generalized to various 2D face image models. Note that this reduces a 3D landmark detection problem to a 2D problem of identifying the corresponding landmarks on two 2D projection images generated from two different projection angles. Here, the 3D landmarks for registration were selected from the sub-surfaces with the least geometric change under the CBCT and face scan environments. For the final fine-tuning of the registration, the Iterative Closest Point method was applied, which utilizes geometrical information around the 3D landmarks. The experimental results show that the proposed method achieved an averaged surface distance error of 0.74 mm for three pairs of CBCT and face scan datasets.

Digital Dental Biometrics for Human Identification Based on Automated 3D Point Cloud Feature Extraction and Registration

A Novel Method of Human Identification Based on Dental Impression Image.

Clinically Applicable System For 3D Teeth Segmentation in Intraoral Scans using Deep Learning

Identification Technology Based on Geometric Features of Tooth Print Images

Human Identification Using Tooth Based on PointNet++.

3D Superimposition of Human Dentition Contours in Personal Identification: A Preliminary Study.

Three-dimensional Superimposition of Digital Models for Individual Identification

A fully automated method for 3D individual tooth identification and segmentation in dental CBCT

A Fine-Grained Network for Human Identification Using Panoramic Dental Images

LCANet: Learnable Connected Attention Network for Human Identification Using Dental Images.

High-precision teeth reconstruction based on automatic multimodal fusion with CBCT and IOS

AI-enabled Automatic Multimodal Fusion of Cone-Beam CT and Intraoral Scans for Intelligent 3D Tooth-Bone Reconstruction and Clinical Applications

Automatic 3D Registration of Dental CBCT and Face Scan Data using 2D Projection Images

Toward Clinically Applicable 3-Dimensional Tooth Segmentation via Deep Learning

Accurate estimation of 6-DoF tooth pose in 3D intraoral scans for dental applications using deep learning

TeethDreamer: 3D Teeth Reconstruction from Five Intra-oral Photographs

Novel Procedure for Automatic Registration between Cone-Beam Computed Tomography and Intraoral Scan Data Supported with 3D Segmentation

Automatic 3D Teeth Reconstruction from Five Intra-Oral Photos Using Parametric Teeth Model.

Automatic Human Identification from Panoramic Dental Radiographs Using the Convolutional Neural Network.

Automatic recognition of landmarks on digital dental models

3D Tooth Instance Segmentation Learning Objectness and Affinity in Point Cloud