Teacher-Student Learning Using Focal and Global Distillation for Accurate Cephalometric Landmark Detection

Yu Shen,Qiao Xu,Yinhao Li,Yen Wei Chen
DOI: https://doi.org/10.1007/978-981-99-3311-2_22
2023-01-01
Abstract:Cephalometric analysis is used frequently by dentists and orthodontists to analyze the role of the human skull in making a diagnosis and formulating treatment plans. To perform such analysis, cephalometric landmarks first need to be annotated manually. In recent years, various automatic cephalometric landmark detection methods, using deep learning, have been formulated and have achieved promising results. Previously, we proposed a teacher–student learning method based on composed ground truth images, and in this paper, we refine our previous methods using focal and global distillation during the teacher–student training process. We create a mask to distinguish the foreground and background areas of landmarks and perform knowledge distillation separately as the focal distillation. We also add a feature similarity penalty interceding between the teacher and student models as the global distillation. Our method achieves state-of-the-art performance on the in-house dataset provided by Shandong University.
What problem does this paper attempt to address?