Abstract:Virtual reality (VR) is a computer-simulated three-dimensional environment whose goal is to achieve a strong sense of being there, called immersion. This requires a variety of technologies: the most essential being input devices. At present, the non-contact Kinect somatosensory interaction approach has been widely studied. Somatosensory interactive games take body movements as input instructions, instead of the simple push-button operation mode. Hence, the operational behavior is more intuitive and the reaction of players is highly accurate and brings a better game experience to players. In terms of man–machine interaction in somatosensory interactive games, gesture interaction brings the primary operation medium into the virtual environment. This paper analyzes the problems of somatosensory games interaction in immersive virtual reality, focusing on gesture-based immersive virtual reality technology. The main work includes: First, aiming at the problem that the gesture recognition method cannot adapt to the real-time continuous gesture flow in practical application scenarios, a naive Bayes gesture recognition algorithm based on joint vector is proposed. The algorithm uses a decision support system for feature representation of bone and motion along with the joint vector. It introduces the adaptive naive Bayes algorithm, which can complete the training with fewer samples. Experimental results show that the algorithm has a high recognition rate and recognition speed, can effectively adapt to continuous data flow, has good compatibility with virtual reality applications, and significantly increases the user's sense of immersion in virtual scenes. Secondly, in view of the lack of complete visual feedback solutions for gesture interaction, a 3D user interface and interaction method combining bone animation and collision detection technology is proposed. The process interacts with the virtual environment through gesture feedback from 3DUI elements. Experimental results show that the design can effectively enhance the immersive experience through the visual feedback of gestures.

An Empirical Practice of Design and Evaluation of Freehand Interaction Gestures in Virtual Reality

Advancing Virtual Reality Interaction: A Ring-Shaped Controller and Pose Tracking

Hand-adaptive User Interface: Improved Gestural Interaction in Virtual Reality

Controller-free Hand Tracking for Grab-and-place Tasks in Immersive Virtual Reality: Design Elements and their Empirical Study

Hand Interfaces: Using Hands to Imitate Objects in AR/VR for Expressive Interactions

User Experience of Virtual-Reality Interactive Interfaces: A Comparison Between Hand Gesture Recognition and Joystick Control for XRSPACE MANOVA

An Empirical Evaluation on Arm Fatigue in Free Hand Interaction and Guidelines for Designing Natural User Interfaces in VR.

Elicitation and Evaluation of Hand-based Interaction Language for 3D Conceptual Design in Mixed Reality

Hand-based Interaction for Object Manipulation with Augmented Reality Glasses

Natural Hand Remapping: Velocity Adaptive Hand Manipulation for VR

Interaction and control with the auxiliary of hand gesture

Behavior Mapping Of Sketching In Vr Space With Physical Tablet Interface

Real World Hand Gesture Interaction in Virtual Reality

Experimental Analysis of Freehand Multi-Object Selection Techniques in Virtual Reality Head-Mounted Displays

Designing Upper-Body Gesture Interaction with and for People with Spinal Muscular Atrophy in VR

User-elicited Dual-Hand Interactions for Manipulating 3D Objects in Virtual Reality Environments

Application of Artificial Intelligence in Hand Gesture Recognition with Virtual Reality: Survey and Analysis of Hand Gesture Hardware Selection

Get a Grip: Evaluating Grip Gestures for VR Input using a Lightweight Pen

An Analysis of Interactive Experience Based on the Gesture Recognition VR System

High-Fidelity Grasping In Virtual Reality Using A Glove-Based System

Key technologies of human–computer interaction for immersive somatosensory interactive games using VR technology