35.1: A novel in‐situ interactive 3D floating autostereoscopic display system with aerial imaging plate
Nan Zhang,Tianqi Huang,Xinran Zhang,Hongen Liao
DOI: https://doi.org/10.1002/sdtp.14444
2021-02-01
SID Symposium Digest of Technical Papers
Abstract:Background Augmented reality technology provides intuitive three‐dimensional (3D) visualization and interaction. Remarkably, the development has drawn increasing attention from the medical, industrial, and commercial communities in recent years. In the clinic or other fields, 3D displays often need to ensure highly‐friendly interaction for multiple users. Methods In this study, we proposed a floating interactive naked‐eye 3D display system that can meet the observation of multiple users and realize in‐situ interaction with floating models. The 3D light‐field generated by autostereoscopic is project into mid‐air by an aerial imaging plate. To address the symmetrical flipping of viewpoints caused by aerial imaging plate, a light‐field symmetrical multi‐viewpoint rendering algorithm based on multi‐view rendering method was proposed. Leap Motion was utilized as a gesture recognition device to capture user's in‐situ interact gesture on floating 3D model. Results The proposed system implemented a floating 3D display with medium‐free imaging and no‐wear burden. The floating model can be highly controlled by users in four developed gestures including anatomical markers, model rotation, translation, and zoom, with a refresh rate of 30 frames per second (render a virtual model with 111888 faces). Conclusions We proposed a mid‐air autostereoscopic 3D display system and a light‐field symmetrical multi‐viewpoint rendering algorithm. It has considerable application prospects in anatomy education, marking points in surgery planning, and displaying 3D objects in museums, shopping mall and others.