Evolution of a Large Language Model for Preoperative Assessment Based on the Japanese Circulation Society 2022 Guideline on Perioperative Cardiovascular Assessment and Management for Non-Cardiac Surgery

Takahiro Kamihara,Masanori Tabuchi,Takuya Omura,Yumi Suzuki,Tsukasa Aritake,Akihiro Hirashiki,Manabu Kokubo,Atsuya Shimizu
DOI: https://doi.org/10.1253/circrep.CR-24-0019
2024-03-15
Abstract:Background: The Japanese Circulation Society 2022 Guideline on Perioperative Cardiovascular Assessment and Management for Non-Cardiac Surgery standardizes preoperative cardiovascular assessments. The present study investigated the efficacy of a large language model (LLM) in providing accurate responses meeting the JCS 2022 Guideline. Methods and Results: Data on consultation requests, physicians' cardiovascular records, and patients' response content were analyzed. Virtual scenarios were created using real-world clinical data, and a LLM was then consulted for such scenarios. Conclusions: Google BARD could accurately provide responses in accordance with the JCS 2022 Guideline in low-risk cases. Google Gemini has significantly improved its accuracy in intermediate- and high-risk cases.
What problem does this paper attempt to address?