Can Publicly Available Artificial Intelligence Successfully Identify Current Procedural Terminology Codes for Common Procedures in Neurosurgery?

Geoffrey R. O’Malley,Syed A. Sarwar,Nicholas D. Cassimatis,Rohit Prem Kumar,Sean Munier,Steven Shill,William Maggio,Ghasan Ahmad,Jasdeep S. Hundal,Shabbar F. Danish,Nitesh V. Patel
DOI: https://doi.org/10.1016/j.wneu.2024.01.043
IF: 2.21
2024-01-14
World Neurosurgery
Abstract:Objective Coding for Neurosurgical procedures is a complex process that is dynamically changing year to year, through the annual introduction and removal of codes and modifiers. The authors hoped to elucidate if publicly available artificial intelligence (AI) could offer solutions for neurosurgeons in regards to coding. Methods Multiple publicly available AI were asked to provide Current Procedural Terminology (CPT) codes and Revenue Value Units (RVU) values for common neurosurgical procedures of the brain and spine with a given indication for the procedure. The responses of platforms were recorded and compared to the currently valid CPT codes used for the procedure and the amount of RVUs that would be gained. Results Six platforms and Google were asked for the appropriate CPT codes for ten endovascular, spinal and cranial procedures each. The highest performing platforms were as follows: Perplexity.AI identified 70% of endovascular, BingAI identified 55% of spinal, and Chat GPT 4.0 with Bing identified 75% of cranial CPT codes. In regard to RVUs, the top performer gained 78% of endovascular, 42% of spinal, and 70% of cranial possible RVUs. In regard to accuracy, AI platforms on average outperformed Google (45% v. 25%, p=0.04236). Conclusions The ability of publicly available AIs to successfully code for neurosurgical procedures holds great promise in the future. Future development of AI should focus on improving accuracy in regard to CPT codes and provide supporting documentation for its decisions. Improvement on the existing capabilities of AI platforms can allow for increased operational efficiency and cost savings for practices.
surgery,clinical neurology
What problem does this paper attempt to address?