Operator Assistance for Remote Driving with Augmented Image based on Gaze Information

Kenya Suzuki,Y. Yano,S. Doki,K. Doki,Yuki Funabora
DOI: https://doi.org/10.1109/isie51582.2022.9831663
2022-06-01
Abstract:The authors have been aiming to realize a remote driving system with an HMD(Head Mounted Display) and a 360-degree camera to decrease the task load of the operator. Therefore, we have been tackling an operator assistance method of remote driving applying Augmented Reality(AR). In the previously proposed methods, AR video presented to the operator is generated based on sensing information of 3D LiDAR to deal with the communication delay. In this paper, a new generation method of AR image is proposed, in which Gaze information of the operator is used to create a 3D object to draw his attention to a hazard that might cause a traffic accident. The usefulness of the proposed method has been evaluated based on the results of the experiments using a driving simulator which has a scenario of a person jumping out from a park.
Computer Science,Engineering
What problem does this paper attempt to address?