Static and Dynamic Hand Gestures: A Review of Techniques of Virtual Reality Manipulation

Oswaldo Mendoza Herbert,David Pérez-Granados,Mauricio Alberto Ortega Ruiz,Rodrigo Cadena Martínez,Carlos Alberto González Gutiérrez,Marco Antonio Zamora Antuñano

DOI: https://doi.org/10.3390/s24123760

IF: 3.9

2024-06-10

Sensors

Abstract:This review explores the historical and current significance of gestures as a universal form of communication with a focus on hand gestures in virtual reality applications. It highlights the evolution of gesture detection systems from the 1990s, which used computer algorithms to find patterns in static images, to the present day where advances in sensor technology, artificial intelligence, and computing power have enabled real-time gesture recognition. The paper emphasizes the role of hand gestures in virtual reality (VR), a field that creates immersive digital experiences through the Ma blending of 3D modeling, sound effects, and sensing technology. This review presents state-of-the-art hardware and software techniques used in hand gesture detection, primarily for VR applications. It discusses the challenges in hand gesture detection, classifies gestures as static and dynamic, and grades their detection difficulty. This paper also reviews the haptic devices used in VR and their advantages and challenges. It provides an overview of the process used in hand gesture acquisition, from inputs and pre-processing to pose detection, for both static and dynamic gestures.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

What problem does this paper attempt to address?

The main problem this paper attempts to address is the technical challenges of hand gesture detection in Virtual Reality (VR), particularly the recognition and application of static and dynamic gestures. Specifically, the paper focuses on the following aspects:

1. **History and Development of Gesture Detection**: It reviews the development of gesture detection technology starting from the 1990s, when it mainly relied on computer algorithms to find patterns in static images, to the present day where real-time gesture recognition is achieved through advancements in sensor technology, artificial intelligence, and computing power.

2. **Role of Gestures in Virtual Reality**: It emphasizes the importance of hand gestures in virtual reality, which can enhance user immersion and interaction capabilities. This is particularly significant in creating realistic digital experiences that combine 3D modeling, sound effects, and sensor technology.

3. **Gesture Classification and Detection Difficulty**: It categorizes gestures into static and dynamic types and evaluates their detection difficulty. Static gestures are typically used to convey simple or complex information, while dynamic gestures are used to express actions or more complex ideas.

4. **Hardware and Software Technologies**: It introduces the current state-of-the-art hardware and software technologies used for hand gesture detection, with a particular focus on virtual reality applications. It discusses the advantages and challenges of visual systems and haptic devices.

5. **Gesture Detection Process**: It outlines the process of gesture detection, including steps such as input, preprocessing, and pose detection, as well as commonly used algorithms and techniques like deep learning, Convolutional Neural Networks (CNN), and Support Vector Machines (SVM).

6. **Future Development Directions**: It explores the future applications of gesture detection technology in virtual reality, particularly how the combination of visual and haptic systems can improve detection accuracy and user experience.

Overall, this paper aims to comprehensively summarize and analyze the current state and challenges of hand gesture detection technology in the field of virtual reality, providing a reference for future research and development.