Abstract:In such application of VR to teleoperation, the most important thing is to keep the virtual environment consistent with the real environment as most of the operating time. If this can be ensured, a good part of practical teleoperation can be performed in an automatic way. Following this idea, we have developed a model-based dynamic calibration algorithm for the consistency of the two environments. First, model of the real environment is created by moving a camera through the environment. We use multi-position-based stereo vision technique. In the process of rehearsal, path is planned by the operator for a specific task. In such case, places that have complex structures for teleoperation such as turning corners, narrow spaces, etc. are defined as key positions by the operator, where local landmarks are set for later dynamic calibration. During practical teleoperation, the robot moves through the planned paths for all the areas except the selected key positions. At key positions, 3D positions of the robot are calibrated by matching features of the landmarks in the images and their corresponding features in the models interactively. Errors detected between the virtual and real environments are recorded to amend the planned path for the coming robot movements. When the robot is approaching near the target, it will be difficult for the operator to determine accurate position of the target in teleoperation. We propose and implement a marker-based algorithm for automatic location of the target at such case. Preliminary experiments have been carried out using a setup consisting of a 4 DOF movable platform, a camera and a laser gun mounted on the platform. Several small cubes are used as landmarks and placed in a room-like environment with several polyhedrons as obstacles. The target is a laser-light-receiver placed inside a small hole on a planar surface of arbitrary pose. The task is to shoot a laser beam from the laser gun into the receiver. The experimental result was quite satisfactory.

Design of Virtual Scene Simulation System for Optoelectronic Tracking Equipment

Research on Virtual-actual Design Environment of Command Compartment

A Design of Algorithm for Excimer Laser Coaxial Observation Automatic Tracking Processing System

Development of Visible-Light Optical Simulator Based on Liquid Crystal on Silicon Technology

3D Virtual Studio System Based on Electromechanical Tracking

Real-time Simulation System of Satellite and Outer Space Scene

Tactical Communication Equipment Simulation Training Platform Based on VR

Research on Visual Simulation of Space Target Optical Imaging

2D Tracking Algorithm Performance Testing Based on Three- Dimensional Visual Platform

Research on Designing and Realizing the Virtual Scene Using Vega Based on MFC

Simulation and testing system of vision-based tracking robot

Simulation and Implementation of Typical Optical Path Adjustments Involved in an Optical Virtual Lab

Virtual Real-Time Walkthrough of Multi-Spectral Scene

Optical Image Simulation System for Space Surveillance

A Virtual-Reality Spatial Matching Algorithm and Its Application on Equipment Maintenance Support: System Design and User Study

Research of Simulation Missile Defense System Based on Vega

Using Virtual Environment to Aid Teleoperation

Research on the Real-Time Mechatronic System Simulation Based on Virtual Reality

A semi-physical simulation system for binocular vision guided rendezvous

AN IMMERSIVE VIRTUAL ENVIRONMENT TRAINING SYSTEM ON THE REAL-TIME MOTION PLATFORM

Research and Development of OpenGL-based Construction Virtual Simulation Platform