Abstract:Interactions within virtual environments often require manipulating 3D virtual objects. To this end, researchers have endeavoured to find efficient solutions using either traditional input devices or focusing on different input modalities, such as touch and mid‐air gestures. Different virtual environments and diverse input modalities present specific issues to control object position, orientation and scaling: traditional mouse input, for example, presents non‐trivial challenges because of the need to map between 2D input and 3D actions. While interactive surfaces enable more natural approaches, they still require smart mappings. Mid‐air gestures can be exploited to offer natural manipulations mimicking interactions with physical objects. However, these approaches often lack precision and control. All these issues and many others have been addressed in a large body of work. In this article, we survey the state‐of‐the‐art in 3D object manipulation, ranging from traditional desktop approaches to touch and mid‐air interfaces, to interact in diverse virtual environments. We propose a new taxonomy to better classify manipulation properties. Using our taxonomy, we discuss the techniques presented in the surveyed literature, highlighting trends, guidelines and open challenges, that can be useful both to future research and to developers of 3D user interfaces. Interactions within virtual environments often require manipulating 3D virtual objects. We survey the state‐of‐the‐art in 3D object manipulation, ranging from traditional desktop approaches to touch and mid‐air interfaces, to interact in diverse virtual environments. We propose a new taxonomy to better classify manipulation properties. Using our taxonomy, we discuss the techniques presented in the surveyed literature, highlighting trends, guidelines and open challenges, that can be useful both to future research and to developers of 3D user interfaces.

Towards “Avatar-Friendly” 3D Manipulation Techniques: Bridging the Gap Between Sense of Embodiment and Interaction in Virtual Reality

Controlled Interaction: Strategies for Using Virtual Reality to Study Perception

A Survey on 3D Virtual Object Manipulation: From the Desktop to Immersive Virtual Environments

Three Perspectives on Embodied Learning in Virtual Reality: Opportunities for Interaction Design

Stretch your reach: Studying Self-Avatar and Controller Misalignment in Virtual Reality Interaction

Trick the Body Trick the Mind: Avatar representation affects the perception of available action possibilities in Virtual Reality

Studying the Inter-Relation Between Locomotion Techniques and Embodiment in Virtual Reality

The Impact of Avatar Personalization and Immersion on Virtual Body Ownership, Presence, and Emotional Response

HandAvatar: Embodying Non-Humanoid Virtual Avatars Through Hands.

Investigating the Effects of Avatarization and Interaction Techniques on Near-field Mixed Reality Interactions with Physical Components

Beyond Being Real: A Sensorimotor Control Perspective on Interactions in Virtual Reality

Avatar error in your favor: Embodied avatars can fix users' mistakes without them noticing

Effects of Realism and Representation on Self-Embodied Avatars in Immersive Virtual Environments

Responsive Action Generation By Physically-Based Motion Retrieval And Adaptation

Virtual Co-Embodiment: Evaluation of the Sense of Agency while Sharing the Control of a Virtual Body among Two Individuals

Every "Body" Gets a Say: An Augmented Optimization Metric to Preserve Body Pose during Avatar Adaptation in Mixed/Augmented Reality

Avatars for Teleconsultation: Effects of Avatar Embodiment Techniques on User Perception in 3D Asymmetric Telepresence

Action-control mappings of interfaces in virtual reality: A study of embodied interaction

Perspectives from Naive Participants and Experienced Social Science Researchers on Addressing Embodiment in a Virtual Cyberball Task

AvatarGo: Plug and Play self-avatars for VR

How to Improve Your Virtual Experience -- Exploring the Obstacles of Mainstream VR