Abstract:In recent years, augmented reality (AR) has been a research hotpot. It emphasizes that virtual objects and real scene are merged with the correct perspective relationship. However, most of existing AR systems simply adds virtual objects on real scene image. It means that if a real hand is in front of the virtual object, the virtual object is still cover the hand with wrong occlusion relationship. On the other hand, most systems just present virtual information, preventing user from touching or interacting with the virtual object.. In this paper, we build an AR system achieving mutual occlusion and interaction. Instead of using structure from motion method, we make use of the depth image of Kinect camera to integrate a 3D space volume and track the camera pose as well. Then we propose a layer rendering method according to the depth relationship to implement mutual occlusion fusion. At last, we fulfill collision detection and interaction through a fast voxel detection method. We define the neighbor cube for every virtual surface point and implement the detection in parallel with GPU.

Real-time control and simulation system based on the OpenGL joint robot

Simulation on Robot Assembly Based on OpenGL

HumRoboSim: an Autonomous Humanoid Robot Simulation System

Implementation of 3D Graphical Simulation of Robot

Design and Implementation of Simulation System for the Competitive Robot System

Research on Robot Control System Based on PC

Realistic Virtual Hand Modeling with Applications for Virtual Grasping

The Design and Implementation of 3d Hand-Based Human-Computer Interaction Platform

Three-dimensional Simulation Tool Design Aiming at 6-DOF Manipulator Based on OpenGL

Research and Exploitation of NC Manufacturing 3D Simulation System Based on OpenGL

A touchable virtual screen interaction system with handheld Kinect camera

Application of Interactive Simulation in Foot Orthosis

Simulation System for Robot Virtual Navigation Based on OpenGL

Method for Collision Simulation in Virtual Hand Interaction Based on Skeletal Models

Research and Realization of Robot Experiment System Based on Virtuality and Actuality

Design and implementation of general-purpose vehicle control virtual reality simulation platform

Research of visual programmer and intelligent simulation platform on triaxial motion control system

Real-time 3D Animated Flight Simulation Based on OpenGL

A Robotic Manipulator Control and Simulation System with Qt and VTK

Research and Development of OpenGL-based Construction Virtual Simulation Platform

Study on Three Dimensional Predictive Simulation System of Teleoperation for Free Flying Space Robot