Fusion mixed reality: a novel approach to merge the physical and virtual cath lab

João Silva Marques,Catarina Oliveira,Fausto J Pinto
DOI: https://doi.org/10.1093/eurheartj/ehae632
IF: 39.3
2024-09-30
European Heart Journal
Abstract:We report the feasibility and safety of the first coronary angiography and angioplasty procedures using the advanced visualization capabilities of the Meta Quest 3 virtual reality (VR) headset (Meta Platforms, Inc.). Current VR devices provide high-resolution images and low latency, but their pass-through mode—which uses cameras to project surroundings onto miniaturized screens—falls short compared with direct vision for manipulating medical devices. To overcome this, we developed fusion mixed reality, which combines direct visualization with mixed reality capabilities. By removing the facial interface and using a halo-type head strap, we directly visualized interventional devices while superimposing virtual screens in front of the operator ( Panel A ). This preserves the wide field of view essential for procedures and allows precise handling of catheters and guidewires under direct visualization ( Panel B ). The mixed reality environment enables customization of screen placement and size via hand gestures, maintaining sterility ( Panel C ), and could save space in future cath labs by replacing physical screens.
cardiac & cardiovascular systems
What problem does this paper attempt to address?