Diagnosis of malignancy in oropharyngeal confocal laser endomicroscopy using GPT 4.0 with vision

Matti Sievert,Marc Aubreville,Sarina Katrin Mueller,Markus Eckstein,Katharina Breininger,Heinrich Iro,Miguel Goncalves
DOI: https://doi.org/10.1007/s00405-024-08476-5
2024-02-10
European Archives of Oto-Rhino-Laryngology
Abstract:Confocal Laser Endomicroscopy (CLE) is an imaging tool, that has demonstrated potential for intraoperative, real-time, non-invasive, microscopical assessment of surgical margins of oropharyngeal squamous cell carcinoma (OPSCC). However, interpreting CLE images remains challenging. This study investigates the application of OpenAI's Generative Pretrained Transformer (GPT) 4.0 with Vision capabilities for automated classification of CLE images in OPSCC.
otorhinolaryngology
What problem does this paper attempt to address?