Deep Learning Techniques for Automatic Lateral X-ray Cephalometric Landmark Detection: Is the Problem Solved?

Hongyuan Zhang,Ching-Wei Wang,Hikam Muzakky,Juan Dai,Xuguang Li,Chenglong Ma,Qian Wu,Xianan Cui,Kunlun Xu,Pengfei He,Dongqian Guo,Xianlong Wang,Hyunseok Lee,Zhangnan Zhong,Zhu Zhu,Bingsheng Huang
2024-09-24
Abstract:Localization of the craniofacial landmarks from lateral cephalograms is a fundamental task in cephalometric analysis. The automation of the corresponding tasks has thus been the subject of intense research over the past decades. In this paper, we introduce the "Cephalometric Landmark Detection (CL-Detection)" dataset, which is the largest publicly available and comprehensive dataset for cephalometric landmark detection. This multi-center and multi-vendor dataset includes 600 lateral X-ray images with 38 landmarks acquired with different equipment from three medical centers. The overarching objective of this paper is to measure how far state-of-the-art deep learning methods can go for cephalometric landmark detection. Following the 2023 MICCAI CL-Detection Challenge, we report the results of the top ten research groups using deep learning methods. Results show that the best methods closely approximate the expert analysis, achieving a mean detection rate of 75.719% and a mean radial error of 1.518 mm. While there is room for improvement, these findings undeniably open the door to highly accurate and fully automatic location of craniofacial landmarks. We also identify scenarios for which deep learning methods are still failing. Both the dataset and detailed results are publicly available online, while the platform will remain open for the community to benchmark future algorithm developments at <a class="link-external link-https" href="https://cl-detection2023.grand-challenge.org/" rel="external noopener nofollow">this https URL</a>.
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?
### Problems Addressed by the Paper This paper aims to explore the performance of the current state-of-the-art deep learning methods in automatic cephalometric landmark detection. Specifically, the authors constructed a multi-center, multi-vendor comprehensive dataset (named CL-Detection) and organized the CL-Detection2023 challenge to evaluate the performance of these methods. **Main issues include:** 1. **Accuracy of craniofacial landmark detection**: - Accurately locating craniofacial landmarks from cephalometric images is a fundamental task in cephalometric analysis. Traditional manual marking methods are not only time-consuming and labor-intensive but also prone to inter-observer variability. Therefore, automated landmark detection methods are of significant importance. 2. **Limitations of existing datasets**: - Previous datasets typically contain data from a single center and a single vendor, with a limited number of annotated landmarks. This results in performance achieved on these datasets potentially not being generalizable to more diverse datasets. 3. **Generalization ability of deep learning methods**: - Although deep learning-based methods have made significant progress in landmark detection in recent years, whether these methods can maintain high performance on diverse datasets remains an unresolved issue. ### Main Contributions of the Paper 1. **Constructed a multi-center, multi-vendor comprehensive dataset**: - The CL-Detection dataset is the largest and most comprehensive publicly available cephalometric landmark detection dataset to date, containing 600 lateral X-ray images and 38 landmarks from three medical centers. 2. **Organized the CL-Detection2023 challenge**: - Through this challenge, the authors evaluated algorithms submitted by research teams from different backgrounds, providing an impartial comparison platform. 3. **Analyzed the performance of top algorithms**: - The authors reported the performance of the top 10 research teams' algorithms in the challenge, showing that the best methods approached expert-level performance, with an average detection rate of 75.719% and an average radial error of 1.518 mm. 4. **Proposed algorithmic techniques to improve landmark detection accuracy**: - The authors summarized various algorithmic techniques and provided suggestions for improvement. 5. **Identified limitations of existing solutions**: - Based on the challenge submissions, the authors pointed out that existing methods still have issues in certain scenarios, providing directions for further research. ### Conclusion Although existing deep learning methods have made significant progress in cephalometric landmark detection, there are still shortcomings in some complex scenarios. Therefore, the problem of cephalometric landmark detection is not yet fully solved and requires further research and improvement.