Abstract:Augmented Reality (AR) teleconferencing allows spatially distributed users to interact with each other in 3D through agents in their own physical environments. Existing methods leveraging volumetric capturing and reconstruction can provide a high-fidelity experience but are often too complex and expensive for everyday use. Other solutions target mobile and effortless-to-setup teleconferencing on AR Head Mounted Displays (HMD). They directly transplant the conventional video conferencing onto an AR-HMD platform or use avatars to represent remote participants. However, they can only support either a high fidelity or a high level of co-presence. Moreover, the limited Field of View (FoV) of HMDs could further degrade users' immersive experience. To achieve a balance between fidelity and co-presence, we explore using life-size 2D video-based avatars (video avatars for short) in AR teleconferencing. Specifically, with the potential effect of FoV on users' perception of proximity, we first conducted a pilot study to explore the local-user-centered optimal placement of video avatars in small-group AR conversations. With the placement results, we then implement a proof-of-concept prototype of video-avatar-based teleconferencing. We conduct user evaluations with our prototype to verify its effectiveness in balancing fidelity and co-presence. Following the indication in the pilot study, we further quantitatively explore the effect of FoV size on the video avatar's optimal placement through a user study involving more FoV conditions in a VR-simulated environment. We regress placement models to serve as references for computationally determining video avatar placements in such teleconferencing applications on various existing AR HMDs and future ones with bigger FoVs.

TeleHuman2

General-purpose Telepresence with Head-Worn Optical See-Through Displays and Projector-Based Lighting

Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using Sparse RGB Cameras

Tele-Aloha: A Telepresence System with Low-budget and High-authenticity Using Sparse RGB Cameras

Tele-AR System Based on Real-time Camera Tracking

Real-Time Human Motion Transfer System for Holographic Displays

Real-time stereoscopic rendering of realistic avatar for interactive 3D telepresence system

42.4L: Late‐News Paper: Footprint of Scalable 3D Telecommunication: Using Integral Light Field Display and Kinect‐based Capture

Full-Body Pose Estimation of Humanoid Robots Using Head-Worn Cameras for Digital Human-Augmented Robotic Telepresence

Mixed reality human teleoperation with device-agnostic remote ultrasound: Communication and user interaction

Bringing Telepresence to Every Desk

33‐1: Invited Paper: Tabletop True 3D Display Systems Based on Projection Light Field and Integral Imaging

Real-and-Present: Investigating the Use of Life-Size 2D Video Avatars in HMD-Based AR Teleconferencing

Project Starline: A high-fidelity telepresence system

Low-cost telepresence for collaborative virtual environments

Enhanced Visual Feedback with Decoupled Viewpoint Control in Immersive Humanoid Robot Teleoperation using SLAM

Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration

Perceiving and rendering users in a 3D interaction

Real-Time 3D Reconstruction Method for Holographic Telepresence

Stability and Transparency in Mixed Reality Bilateral Human Teleoperation