Requirement analysis for an AI-based AR assistance system for surgical tools in the operating room: stakeholder requirements and technical perspectives

Cramer, E.
DOI: https://doi.org/10.1007/s11548-024-03193-0
2024-06-08
International Journal of Computer Assisted Radiology and Surgery
Abstract:We aim to investigate the integration of augmented reality (AR) within the context of increasingly complex surgical procedures and instrument handling toward the transition to smart operating rooms (OR). In contrast to cumbersome paper-based surgical instrument manuals still used in the OR, we wish to provide surgical staff with an AR head-mounted display that provides in-situ visualization and guidance throughout the assembly process of surgical instruments. Our requirement analysis supports the development and provides guidelines for its transfer into surgical practice.
engineering, biomedical,radiology, nuclear medicine & medical imaging,surgery
What problem does this paper attempt to address?
This paper aims to explore and address the issues associated with using paper manuals to guide the assembly of surgical instruments in the operating room, and proposes an auxiliary system based on Artificial Intelligence (AI) and Augmented Reality (AR) technologies to improve this process. Specifically, the paper attempts to solve the following main problems: 1. **Limitations of using paper manuals**: Currently, operating rooms widely rely on paper manuals to guide the assembly of complex surgical instruments. However, this method has numerous issues, such as sterile personnel being unable to directly touch non-sterile paper manuals, and the information in the manuals being either missing or excessive, leading to difficulties in understanding. 2. **Challenges brought by the increasing complexity and number of surgical instruments**: With the development of surgical techniques, surgical instruments have become increasingly complex and diverse. This imposes a significant cognitive load on the surgical team, increasing the risk of errors and surgical delays. 3. **Improving surgical efficiency and safety**: By introducing an AI and AR-based guidance system, it is possible to provide precise guidance information in real-time at the surgical site, thereby reducing workload, lowering error rates, and ultimately improving surgical quality and patient safety. In summary, the goal of this research is to develop an auxiliary system integrating AI and AR technologies to support the operating room team in obtaining immediate and accurate information guidance during the assembly of surgical instruments, thereby enhancing efficiency and safety in the surgical process.