Accuracy of ChatGPT responses on tracheotomy for patient education

Amina Khaldi,Shahram Machayekhi,Michele Salvagno,Antonino Maniaci,Luigi A. Vaira,Luigi La Via,Fabio S. Taccone,Jerome R. Lechien
DOI: https://doi.org/10.1007/s00405-024-08859-8
2024-10-03
European Archives of Oto-Rhino-Laryngology
Abstract:To investigate the accuracy of information provided by ChatGPT-4o to patients about tracheotomy. Twenty common questions of patients about tracheotomy were presented to ChatGPT-4o twice (7-day intervals). The accuracy, clarity, relevance, completeness, referencing, and usefulness of responses were assessed by a board-certified otolaryngologist and a board-certified intensive care unit practitioner with the Quality Analysis of Medical Artificial Intelligence (QAMAI) tool. The interrater reliability and the stability of the ChatGPT-4o responses were evaluated with intraclass correlation coefficient (ICC) and Pearson correlation analysis.
otorhinolaryngology
What problem does this paper attempt to address?