Abstract:We propose a visual tele-AR system, which is a combination of tele-existence and AR techniques. By wearing a video see-through HMD and moving his head, a user in this system is able to tele-operate a remote pan-tilt platform to observe the remote scene. Unlike traditional tele-existence systems which use mechanical or magnetic sensors for tele-operation, we propose a novel tele-operation method based on real-time tracking of master and slave cameras. The master camera is a component of the video see-through HMD mounted in front of user's eyes, while the slave camera is carried by a remote platform. We estimate use's head motion by tracking the master camera in real time, and translate head motions into motion commands to drive the remote pan-tilt platform. Ideally, motion of the remote platform will be exactly the same as user's head. Unfortunately, motion speed of the slave platform is usually limited by their mechanical capability, which may cause pose inconsistence between master and slave cameras, especially when user's head moves fast. We solve this problem by also tracking slave camera in real time, and warping video images according to difference between master and slave camera pose. Since slave camera is tracked, we can integrate virtual objects into remote scene, giving the user an augmented visual sense. To reduce system delay, our implementation is accelerated GPU parallel computation. Experimental results show the efficiency and robustness of our method.

See-through Camera for Integration with AR Devices

Toward a See-Through Camera Via AR Lightguide.

AR Cameras

Color Transparent Screen Using Planar Glass Combined with Lens Array Holographic Optical Elements

Hybrid Meta-Optics Enabled Compact Augmented Reality Display with Computational Image Reinforcement

Color Waveguide Transparent Screen Using Lens Array Holographic Optical Element

A touchable virtual screen interaction system with handheld Kinect camera

Computer-generated holographic near-eye display system based on LCoS phase only modulator

Multi-sensor Spatial Augmented Reality for Visualizing the Invisible Thermal Information of 3D Objects

Towards VR and AR

Towards VR and AR enhancement: light field display with mid-air interaction.

Handling Occlusions in Video-Based Augmented Reality Using Depth Information

Augmented reality with image registration, vision correction and sunlight readability via liquid crystal devices

Tele-AR System Based on Real-time Camera Tracking

A Convenient Method of Video See-Through Augmented Reality Based on Image-Guided Surgery System

A Visual-Inertial Fusion Based Tracking System For Mobile Augmented Reality

Virtual reality realization technology and its application based on augmented reality.

Multi-plane augmented reality display based on cholesteric liquid crystal reflective films

56.2: Invited Paper: Evaluation of Optical See‐through Real Scene Image Quality in AR Eyewear Displays

Full-colour 3D holographic augmented-reality displays with metasurface waveguides

See-Through Face Display: Enabling Gaze Communication for Any Face$\unicode{x2013}$Human or AI