Abstract:Interactions within virtual environments often require manipulating 3D virtual objects. To this end, researchers have endeavoured to find efficient solutions using either traditional input devices or focusing on different input modalities, such as touch and mid‐air gestures. Different virtual environments and diverse input modalities present specific issues to control object position, orientation and scaling: traditional mouse input, for example, presents non‐trivial challenges because of the need to map between 2D input and 3D actions. While interactive surfaces enable more natural approaches, they still require smart mappings. Mid‐air gestures can be exploited to offer natural manipulations mimicking interactions with physical objects. However, these approaches often lack precision and control. All these issues and many others have been addressed in a large body of work. In this article, we survey the state‐of‐the‐art in 3D object manipulation, ranging from traditional desktop approaches to touch and mid‐air interfaces, to interact in diverse virtual environments. We propose a new taxonomy to better classify manipulation properties. Using our taxonomy, we discuss the techniques presented in the surveyed literature, highlighting trends, guidelines and open challenges, that can be useful both to future research and to developers of 3D user interfaces. Interactions within virtual environments often require manipulating 3D virtual objects. We survey the state‐of‐the‐art in 3D object manipulation, ranging from traditional desktop approaches to touch and mid‐air interfaces, to interact in diverse virtual environments. We propose a new taxonomy to better classify manipulation properties. Using our taxonomy, we discuss the techniques presented in the surveyed literature, highlighting trends, guidelines and open challenges, that can be useful both to future research and to developers of 3D user interfaces.

VVIR-OM: Efficient Object Manipulation in VR with Variable Virtual Interaction Region

Advancing Virtual Reality Interaction: A Ring-Shaped Controller and Pose Tracking

Virtual-Physical Interaction System

Enhancing hand-object interactions in virtual reality for precision manual tasks

User-elicited Dual-Hand Interactions for Manipulating 3D Objects in Virtual Reality Environments

The Effect of Semi-Transparent and Interpenetrable Hands on Object Manipulation in Virtual Reality

Dual Quaternion Based Virtual Hand Interaction Modeling

Natural Hand Remapping: Velocity Adaptive Hand Manipulation for VR

Realistic Virtual Hand Modeling with Applications for Virtual Grasping

Swarm manipulation: An efficient and accurate technique for multi-object manipulation in virtual reality

Grasping 3D Objects With Virtual Hand in VR Environment

A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments

Virtual Manipulation in an Immersive Virtual Environment: Simulation of Virtual Assembly

Towards a Virtual Reality Visualization of Hand-Object Interactions to Support Remote Physical Therapy

Mixed interaction: evaluating user interactions for object manipulations in virtual space

Hand-adaptive User Interface: Improved Gestural Interaction in Virtual Reality

Trade-Off between Task Accuracy, Task Completion Time and Naturalness for Direct Object Manipulation in Virtual Reality

Reducing Arm Fatigue in Virtual Reality by Introducing 3D-Spatial Offset

Haptic Feedback Relocation from the Fingertips to the Wrist for Two-Finger Manipulation in Virtual Reality

Comparing Different Grasping Visualizations for Object Manipulation in VR using Controllers

HOOV: Hand Out-Of-View Tracking for Proprioceptive Interaction using Inertial Sensing