Abstract:In such application of VR to teleoperation, the most important thing is to keep the virtual environment consistent with the real environment as most of the operating time. If this can be ensured, a good part of practical teleoperation can be performed in an automatic way. Following this idea, we have developed a model-based dynamic calibration algorithm for the consistency of the two environments. First, model of the real environment is created by moving a camera through the environment. We use multi-position-based stereo vision technique. In the process of rehearsal, path is planned by the operator for a specific task. In such case, places that have complex structures for teleoperation such as turning corners, narrow spaces, etc. are defined as key positions by the operator, where local landmarks are set for later dynamic calibration. During practical teleoperation, the robot moves through the planned paths for all the areas except the selected key positions. At key positions, 3D positions of the robot are calibrated by matching features of the landmarks in the images and their corresponding features in the models interactively. Errors detected between the virtual and real environments are recorded to amend the planned path for the coming robot movements. When the robot is approaching near the target, it will be difficult for the operator to determine accurate position of the target in teleoperation. We propose and implement a marker-based algorithm for automatic location of the target at such case. Preliminary experiments have been carried out using a setup consisting of a 4 DOF movable platform, a camera and a laser gun mounted on the platform. Several small cubes are used as landmarks and placed in a room-like environment with several polyhedrons as obstacles. The target is a laser-light-receiver placed inside a small hole on a planar surface of arbitrary pose. The task is to shoot a laser beam from the laser gun into the receiver. The experimental result was quite satisfactory.

Effect of Virtual Annotation on Performance of Construction Equipment Teleoperation under Adverse Visual Conditions

Building Human Visual Attention Map for Construction Equipment Teleoperation

Influence of Spatial Ability on Virtual Annotation Response in Construction Equipment Teleoperation

Influence of Spatial Perception Ability on Virtual Annotation Response in Teleoperation of Excavator

A general framework of augmented reality aided teleoperation guidance

Monoscopic vs. Stereoscopic Views and Display Types in the Teleoperation of Unmanned Ground Vehicles for Object Avoidance

Efficiency of VR-Based Safety Training for Construction Equipment: Hazard Recognition in Heavy Machinery Operations

Visual Perception Design and Evaluation of Electric Working Robots

Research on Mixed Reality Visual Augmentation Method for Teleoperation Interactive System.

Influence of visual environments on struck-by hazards for construction equipment operators through virtual eye-tracking

Evaluating visual encoding quality of a mixed reality user interface for human–machine co-assembly in complex operational terrain

Research and Implementation of Teleoperation System Based on Visual-Haptic Aid

Using Virtual Environment to Aid Teleoperation

Flexible Virtual Fixture Enhanced by Vision and Haptics for Unstructured Environment Teleoperation.

Remote Monitoring and Teleoperation of Autonomous Vehicles $-$ Is Virtual Reality an Option?

Design and Implementation of the Teleoperation Platform Based on Augmented Reality

Enhanced Visual Feedback with Decoupled Viewpoint Control in Immersive Humanoid Robot Teleoperation using SLAM

Collaborative Remote Control of Unmanned Ground Vehicles in Virtual Reality

Telepresence augmentation for visual and haptic guided immersive teleoperation of industrial manipulator

Influence of Training Schedule on Development of Perceptual–motor Control Skills for Construction Equipment Operators in a Virtual Training System

3D-point-cloud registration and real-world dynamic modelling-based virtual environment building method for teleoperation.