Generative adversarial network for newborn 3D skeleton part segmentation

Hien-Duyen Nguyen-Le,Morgane Ferrandini,Duc-Phong Nguyen,Vi-Do Tran,Hoai-Danh Vo,Tan-Nhu Nguyen,Tien-Tuan Dao,Nguyen-Le, Hien-Duyen,Ferrandini, Morgane,Nguyen, Duc-Phong,Dao, Tien-Tuan
DOI: https://doi.org/10.1007/s10489-024-05406-0
IF: 5.3
2024-03-27
Applied Intelligence
Abstract:Childbirth simulations have been studied in order to predict and prevent difficult delivery issues. The reconstruction of the maternal pelvic model, which consists of a comprehensive fetal model with articulated joints, is important for therapeutic purposes. However, it is difficult and time-consuming to segment the various bones using classical image processing approaches. The aim of this study is to develop and evaluate a generative adversarial network to automatically segment the bony structures of the complete neonatal skeleton. A database of 124 newborn CT images was collected and segmented. Each 3D reconstructed skeleton was divided into 23 distinct bony segments. We proposed the generative adversarial network based on PointNet to perform the automated segmentation directly on the 3D point clouds. Our method was compared to the pointwise convolutional neural network to demonstrate its accuracy and efficiency. The GAN model produced highly accurate results with an IoU of 93.68% ± 7.37%, a Dice of 96.56% ± 4.41% and an accuracy score of 96.72% ± 3.56%, compared to 72.30% ± 5.10% for IoU, 83.82% ± 3.44% for Dice and 84.81% ± 3.25% for accuracy respectively by the pointwise convolutional neural network. In addition, our model behaved better on skeletons in anatomical postures than ones in fetal positions. This study opens new avenues for fast and accurate 3D part segmentation of the newborn 3D skeleton. In the future, further study should focus on segmenting fused bones like vertebrae and integrating the whole articulated skeleton into the maternal pelvic model to simulate complex vaginal delivery and perform associated preventive actions.
computer science, artificial intelligence
What problem does this paper attempt to address?