Abstract:Augmented Reality (AR) teleconferencing allows spatially distributed users to interact with each other in 3D through agents in their own physical environments. Existing methods leveraging volumetric capturing and reconstruction can provide a high-fidelity experience but are often too complex and expensive for everyday use. Other solutions target mobile and effortless-to-setup teleconferencing on AR Head Mounted Displays (HMD). They directly transplant the conventional video conferencing onto an AR-HMD platform or use avatars to represent remote participants. However, they can only support either a high fidelity or a high level of co-presence. Moreover, the limited Field of View (FoV) of HMDs could further degrade users' immersive experience. To achieve a balance between fidelity and co-presence, we explore using life-size 2D video-based avatars (video avatars for short) in AR teleconferencing. Specifically, with the potential effect of FoV on users' perception of proximity, we first conducted a pilot study to explore the local-user-centered optimal placement of video avatars in small-group AR conversations. With the placement results, we then implement a proof-of-concept prototype of video-avatar-based teleconferencing. We conduct user evaluations with our prototype to verify its effectiveness in balancing fidelity and co-presence. Following the indication in the pilot study, we further quantitatively explore the effect of FoV size on the video avatar's optimal placement through a user study involving more FoV conditions in a VR-simulated environment. We regress placement models to serve as references for computationally determining video avatar placements in such teleconferencing applications on various existing AR HMDs and future ones with bigger FoVs.

Building Semi-Immersing Human-Computer Interaction Environment of Virtual Teleconferencing Based on Multi-Screen General Projection

Immersive Display and Interactive Techniques for the Modeling and Rendering of Virtual Heritage Environments

Modeling and immersive display of cultural heritage

Communication Model for Internet-Oriented 2.5D Virtual Environments

MultiPro: A Platform for PC Cluster Based Active Stereo Display System

Human-Computer Interaction System Based on Binocular Stereo Vision

Natural Interaction Synthesizing in Virtual Teleconferencing

SimWall: a Practical User-Friendly Stereo Tiled Display Wall System

Multi-projector display wall system for windows desktop applications

A Streaming-Based Approach for Remote Interaction of the Multi-Channel Display System for Group Users

Building Virtual Entertainment Environment with Tiled Display Wall and Motion Tracking.

Virtual Reality Based Immersive Telepresence System for Remote Conversation and Collaboration.

Immersive Virtual Tour Using Multi-projection with Remote Cluster Rendering

Real-time stereoscopic rendering of realistic avatar for interactive 3D telepresence system

Low-Complexity 3D-Vision Conferencing System Based on Accelerated RIFE Model

A method for multi-projector seamless tiled display system

A DISTRIBUTED INTERACTIVE PROJECTION SYSTEM BASED ON MULTI-CHANNEL VIDEO CAPTURE

A Multi-modal Virtual-Real Fusion System for Multi-task Human-Computer Interaction.

An Internet-Based Conference System for Real-Time Distributed Design Evaluation

Real-and-Present: Investigating the Use of Life-Size 2D Video Avatars in HMD-Based AR Teleconferencing