AI-Enhanced Virtual Reality in Medicine: A Comprehensive Survey

Yixuan Wu,Kaiyuan Hu,Danny Z. Chen,Jian Wu
2024-07-11
Abstract:With the rapid advance of computer graphics and artificial intelligence technologies, the ways we interact with the world have undergone a transformative shift. Virtual Reality (VR) technology, aided by artificial intelligence (AI), has emerged as a dominant interaction media in multiple application areas, thanks to its advantage of providing users with immersive experiences. Among those applications, medicine is considered one of the most promising areas. In this paper, we present a comprehensive examination of the burgeoning field of AI-enhanced VR applications in medical care and services. By introducing a systematic taxonomy, we meticulously classify the pertinent techniques and applications into three well-defined categories based on different phases of medical diagnosis and treatment: Visualization Enhancement, VR-related Medical Data Processing, and VR-assisted Intervention. This categorization enables a structured exploration of the diverse roles that AI-powered VR plays in the medical domain, providing a framework for a more comprehensive understanding and evaluation of these technologies. To our best knowledge, this is the first systematic survey of AI-powered VR systems in medical settings, laying a foundation for future research in this interdisciplinary domain.
Computer Vision and Pattern Recognition,Human-Computer Interaction
What problem does this paper attempt to address?
This paper aims to explore the application of Artificial Intelligence (AI)-enhanced Virtual Reality (VR) technology in the medical field and systematically investigate how these technologies improve the quality and efficiency of healthcare services. The paper introduces a classification system that divides the relevant technologies and applications into three main categories: visualization enhancement, VR-related medical data analysis, and VR-assisted intervention. 1. **Visualization Enhancement**: This section focuses on enhancing the user's visual and sensory experience in a virtual environment, which is crucial for understanding and interpreting complex anatomical structures, especially in intricate medical procedures. It includes two subcategories: virtual reconstruction and visual enhancement. The former helps doctors intuitively present medical data, while the latter improves visual perception during surgery or training processes. 2. **VR-related Medical Data Analysis**: This part discusses how VR combined with AI technology can analyze and interpret complex medical data, thereby supporting various stages from disease diagnosis to the entire surgical process. It emphasizes the importance of transitioning from traditional 2D data processing to dynamic 3D analysis. 3. **VR-assisted Intervention**: This section showcases the practical applications of AI-driven VR technology in real-time interactive medical scenarios, covering aspects such as direct procedural guidance, intraoperative intervention, and promoting collaboration among medical professionals. Additionally, the paper explores the potential future directions of AI in VR medical applications and considers the ethical, legal, and practical issues that may arise when deploying such advanced systems in sensitive medical environments. In summary, this review paper aims to lay the foundation for research on AI-enhanced VR technology in the medical field and provides a comprehensive framework for understanding how these technologies impact the efficiency, accuracy, and effectiveness of healthcare services.