Landet: an efficient physics-informed deep learning approach for automatic detection of anatomical landmarks and measurement of spinopelvic alignment

AliAsghar MohammadiNasrabadi,Gemah Moammer,Ahmed Quateen,Kunal Bhanot,John McPhee
DOI: https://doi.org/10.1186/s13018-024-04654-7
IF: 2.6
2024-03-26
Journal of Orthopaedic Surgery and Research
Abstract:An efficient physics-informed deep learning approach for extracting spinopelvic measures from X-ray images is introduced and its performance is evaluated against manual annotations.
orthopedics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: **Develop an efficient physics - informed deep - learning method for automatically detecting anatomical landmarks from X - ray images and measuring spino - pelvic parameters**. Specifically, the authors propose a new method (LanDet), which regards anatomical landmarks as objects and introduces geometric constraints to improve detection accuracy and reliability. ### Problem Background 1. **Limitations of Manual Measurement**: - Manual measurement of spino - pelvic parameters (such as sacral slope SS, pelvic tilt PT, pelvic incidence PI, lumbar lordosis LL and sagittal vertical axis SVA) is subjective and time - consuming. - Manual measurement is easily affected by image quality, and measurement results may vary among different doctors. 2. **Challenges of Existing Automated Methods**: - The heatmap regression method has deficiencies in dealing with overlapping signals and post - processing requirements. - Existing automated tools are sometimes difficult to distinguish adjacent or similar anatomical landmarks. ### Solutions Proposed in the Paper 1. **Introduce a Physics - Informed Deep - Learning Model (LanDet)**: - Regard anatomical landmarks as objects and use bounding boxes for annotation. - Introduce geometric constraints to ensure that the model can better understand the relationships between anatomical landmarks, thereby improving detection accuracy. 2. **Dataset and Data Augmentation**: - Use two datasets (DS1 and DS2), which contain a total of 1,470 lateral spine X - ray images. - Adopt multiple data augmentation techniques (such as cropping, flipping, mosaic augmentation and rotation) to increase the diversity of training samples and improve the robustness of the model. 3. **Loss Function Design**: - Modify the main object detection loss function and add geometric constraint terms to better capture the relationships between anatomical landmarks. ### Main Contributions - **Improve the Accuracy of Automatically Detecting Anatomical Landmarks**: By introducing geometric constraints, the model shows higher accuracy and consistency in detecting anatomical landmarks. - **Solve the Limitations of the Heatmap Regression Method**: Avoid overlapping signals and post - processing problems, making the model work effectively in complex scenarios. - **Verify the Reliability and Reproducibility of the Model**: By comparing with the manual measurement results of surgeons, it is proved that the performance of the model is better than or at least not inferior to that of human experts. In conclusion, this paper aims to overcome the limitations of existing automated methods and improve the accuracy and reliability of automatically detecting anatomical landmarks and measuring spino - pelvic parameters from X - ray images by proposing a new physics - informed deep - learning method.