Virtual Reflections on a Dynamic 2D Eye Model Improve Spatial Reference Identification

Matti Krüger,Yutaka Oshima,Yu Fang
2024-12-11
Abstract:The visible orientation of human eyes creates some transparency about people's spatial attention and other mental states. This leads to a dual role for the eyes as a means of sensing and communication. Accordingly, artificial eye models are being explored as communication media in human-machine interaction scenarios. One challenge in the use of eye models for communication consists of resolving spatial reference ambiguities, especially for screen-based models. Here, we introduce an approach for overcoming this challenge through the introduction of reflection-like features that are contingent on artificial eye movements. We conducted a user study with 30 participants in which participants had to use spatial references provided by dynamic eye models to advance in a fast-paced group interaction task. Compared to a non-reflective eye model and a pure reflection mode, their combination in the new approach resulted in a higher identification accuracy and user experience, suggesting a synergistic benefit.
Human-Computer Interaction,Robotics
What problem does this paper attempt to address?
The problem that this paper attempts to solve is: in the human - machine interaction scenario, how to improve the accuracy of spatial reference information conveyance and user experience of the virtual eye model. Specifically, the paper explores overcoming the ambiguity problem of the eye model on a two - dimensional screen display in conveying spatial information by introducing reflection characteristics (i.e., virtual reflection). ### Problem Background 1. **The Dual Roles of the Eye** - The eye is not only a sensory organ for obtaining visual information but also an important communication tool that can convey a person's attention and other mental states. - In human - machine interaction, a model simulating human eyes can be used to attract attention, convey direction, and represent certain mental states, thus supporting more effective cooperation. 2. **Existing Challenges** - **Hardware Limitations**: Achieving realistic eye movement requires a complex driving mechanism, which may lead to unnatural or uncomfortable eye movement performance. - **Lack of Depth Information**: Virtual eyes on a two - dimensional screen are difficult to provide accurate spatial information, especially being prone to ambiguity in multi - target interaction. - **Limited Social Utility**: The lack of depth cues makes it difficult for users to accurately judge the gaze direction and distance, affecting the interaction effect. ### The Solution Proposed in the Paper To overcome the above problems, the author proposes a new method - **Mirror Eyes**, that is, adding reflection characteristics to the virtual eye model. The specific methods are as follows: - **Dynamic Reflection**: By displaying the mirror image of the currently focused area in the virtual eye, observers can directly see the content of the gaze, not just the direction. - **Enhanced Understanding**: This way simplifies the original two - step understanding process (first look at the eyes and then map to the target) into one step, significantly improving the recognition accuracy of spatial references. - **User - friendly**: Mirror Eyes not only improves the recognition accuracy but also enhances the overall user experience. ### Experimental Verification To verify the effectiveness of this method, the researchers designed an experiment and invited 30 participants for testing. The experiment set up three conditions: 1. **Eye - only**: Only eyes, without reflection characteristics. 2. **Mirror - only**: Only reflection, without typical eye features such as pupils and irises. 3. **Mirror - eye**: Combining the previous two conditions, having both eye features and reflection. The experimental results show that: - **Recognition Accuracy**: The recognition accuracy in the Mirror - eye mode is significantly higher than that in the other two modes (p < 0.001), especially showing obvious advantages in single - condition blocks. - **Reaction Time**: There is no significant difference in reaction time among different modes, indicating that the Mirror - eye mode does not increase the user's reaction burden. - **User Experience**: Participants gave higher evaluations to the Mirror - eye mode, especially in terms of practicality and pleasure. ### Conclusion By introducing virtual reflection characteristics, the Mirror - eye model effectively solves the ambiguity problem of the two - dimensional eye model in spatial reference recognition, significantly improving the recognition accuracy and user experience. This achievement provides new ideas and technical means for future human - machine interaction design. --- If you have more questions or need further explanation, please feel free to let us know!