Abstract:Interactions within virtual environments often require manipulating 3D virtual objects. To this end, researchers have endeavoured to find efficient solutions using either traditional input devices or focusing on different input modalities, such as touch and mid‐air gestures. Different virtual environments and diverse input modalities present specific issues to control object position, orientation and scaling: traditional mouse input, for example, presents non‐trivial challenges because of the need to map between 2D input and 3D actions. While interactive surfaces enable more natural approaches, they still require smart mappings. Mid‐air gestures can be exploited to offer natural manipulations mimicking interactions with physical objects. However, these approaches often lack precision and control. All these issues and many others have been addressed in a large body of work. In this article, we survey the state‐of‐the‐art in 3D object manipulation, ranging from traditional desktop approaches to touch and mid‐air interfaces, to interact in diverse virtual environments. We propose a new taxonomy to better classify manipulation properties. Using our taxonomy, we discuss the techniques presented in the surveyed literature, highlighting trends, guidelines and open challenges, that can be useful both to future research and to developers of 3D user interfaces. Interactions within virtual environments often require manipulating 3D virtual objects. We survey the state‐of‐the‐art in 3D object manipulation, ranging from traditional desktop approaches to touch and mid‐air interfaces, to interact in diverse virtual environments. We propose a new taxonomy to better classify manipulation properties. Using our taxonomy, we discuss the techniques presented in the surveyed literature, highlighting trends, guidelines and open challenges, that can be useful both to future research and to developers of 3D user interfaces.

Advances in Interaction with 3D Environments

Hybrid-Dimensional Visualization and Interaction - Integrating 2D and 3D Visualization with Semi-Immersive Navigation Techniques

Controlled Interaction: Strategies for Using Virtual Reality to Study Perception

A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments

The State of the Art of Spatial Interfaces for 3D Visualization

PERCEPTUAL USER INTERFACE IN VIRTUAL SHOPPING ENVIRONMENT

3D Gestural Interaction: The State of the Field

Review of Three-Dimensional Human-Computer Interaction with Focus on the Leap Motion Controller

Entering the Next Dimension: A Review of 3D User Interfaces for Virtual Reality

A review on development approaches for 3D gestural embodied human-computer interaction systems

Usability Comparison of Mouse, Touch and Tangible Inputs for 3D Data Manipulation

Interactive 3-DTV-Concepts and Key Technologies

Usability Studies In Virtual And Traditional Computer Aided Design Environments For Navigation

Elicitation and Evaluation of Hand-based Interaction Language for 3D Conceptual Design in Mixed Reality

3D interaction techniques using gestures recognition in virtual environment

Intuitive Interactive Interface and Virtual Reality

Mixed interaction: evaluating user interactions for object manipulations in virtual space

INTERACT: An authoring tool that facilitates the creation of human centric interaction with 3d objects in virtual reality

Effects of Adaptive Interaction on Three-dimensional Model Browsing Performance

VirtualDesk: A Comfortable and Efficient Immersive Information Visualization Approach

Specification and Structure Design of 3D Interaction Tasks