High‐quality expert annotations enhance artificial intelligence model accuracy for osteosarcoma X‐ray diagnosis

Joe Hasei,Ryuichi Nakahara,Yujiro Otsuka,Yusuke Nakamura,Tamiya Hironari,Naoaki Kahara,Shinji Miwa,Shusa Ohshika,Shunji Nishimura,Kunihiro Ikuta,Shuhei Osaki,Aki Yoshida,Tomohiro Fujiwara,Eiji Nakata,Toshiyuki Kunisada,Toshifumi Ozaki
DOI: https://doi.org/10.1111/cas.16330
IF: 5.7
2024-09-04
Cancer Science
Abstract:This study developed a high‐performance artificial intelligence (AI) model to detect osteosarcoma from X‐ray images using highly accurate annotated training data from experienced oncologists. The model significantly outperformed existing models, achieving state‐of‐the‐art performance and indicating the importance of high‐quality training data in AI development for rare cancer diagnosis. Primary malignant bone tumors, such as osteosarcoma, significantly affect the pediatric and young adult populations, necessitating early diagnosis for effective treatment. This study developed a high‐performance artificial intelligence (AI) model to detect osteosarcoma from X‐ray images using highly accurate annotated data to improve diagnostic accuracy at initial consultations. Traditional models trained on unannotated data have shown limited success, with sensitivities of approximately 60%–70%. In contrast, our model used a data‐centric approach with annotations from an experienced oncologist, achieving a sensitivity of 95.52%, specificity of 96.21%, and an area under the curve of 0.989. The model was trained using 468 X‐ray images from 31 osteosarcoma cases and 378 normal knee images with a strategy to maximize diversity in the training and validation sets. It was evaluated using an independent dataset of 268 osteosarcoma and 554 normal knee images to ensure generalizability. By applying the U‐net architecture and advanced image processing techniques such as renormalization and affine transformations, our AI model outperforms existing models, reducing missed diagnoses and enhancing patient outcomes by facilitating earlier treatment. This study highlights the importance of high‐quality training data and advocates a shift towards data‐centric AI development in medical imaging. These insights can be extended to other rare cancers and diseases, underscoring the potential of AI in transforming diagnostic processes in oncology. The integration of this AI model into clinical workflows could support physicians in early osteosarcoma detection, thereby improving diagnostic accuracy and patient care.
oncology
What problem does this paper attempt to address?