Abstract:In such application of VR to teleoperation, the most important thing is to keep the virtual environment consistent with the real environment as most of the operating time. If this can be ensured, a good part of practical teleoperation can be performed in an automatic way. Following this idea, we have developed a model-based dynamic calibration algorithm for the consistency of the two environments. First, model of the real environment is created by moving a camera through the environment. We use multi-position-based stereo vision technique. In the process of rehearsal, path is planned by the operator for a specific task. In such case, places that have complex structures for teleoperation such as turning corners, narrow spaces, etc. are defined as key positions by the operator, where local landmarks are set for later dynamic calibration. During practical teleoperation, the robot moves through the planned paths for all the areas except the selected key positions. At key positions, 3D positions of the robot are calibrated by matching features of the landmarks in the images and their corresponding features in the models interactively. Errors detected between the virtual and real environments are recorded to amend the planned path for the coming robot movements. When the robot is approaching near the target, it will be difficult for the operator to determine accurate position of the target in teleoperation. We propose and implement a marker-based algorithm for automatic location of the target at such case. Preliminary experiments have been carried out using a setup consisting of a 4 DOF movable platform, a camera and a laser gun mounted on the platform. Several small cubes are used as landmarks and placed in a room-like environment with several polyhedrons as obstacles. The target is a laser-light-receiver placed inside a small hole on a planar surface of arbitrary pose. The task is to shoot a laser beam from the laser gun into the receiver. The experimental result was quite satisfactory.

Recognizing and Locating Objects with the Aid of Specially Designed Markers

An Improved Graph-Based Visual Localization System for Indoor Mobile Robot Using Newly Designed Markers

Research on marker tracking method for augmented reality.

3D Map Building for Mobile Robot under Unknown Outdoor Environments

Marker design and recognition on tiled interaction tabletop

Autonomous Recognition and Positioning of Shield Segments Based on Red, Green, Blue and Depth Information

Application of a Vision-Based Single Target on Robot Positioning System

Simultaneous Identification of Points and Circles: Structure from Motion System in Industry Scenes

Navigation system based on machine vision of multiple reference markers

Mark Points Detection and Measurement on Reflective Surfaces for In-Situ Machining of Large and Complex Components

CSPM: A Novel Curtain Style Pictorial Marker for Enhancing Augmented Reality Experiences.

Using Virtual Environment to Aid Teleoperation

Marker-Based Localisation System Using an Active PTZ Camera and CNN-Based Ellipse Detection

A marker-less assembly stage recognition method based on segmented projection contour

Fabricating Diminishable Visual Markers for Geometric Registration in Projection Mapping

Three-dimensional space orientation tracking method and three-dimensional space orientation tracking system based on virtual marker

NeuralMarker

TopoTag: A Robust and Scalable Topological Fiducial Marker System

Visual-Marker-Based Localization for Flat-Variation Scene

MarkerPose: Robust Real-time Planar Target Tracking for Accurate Stereo Pose Estimation

Study on the Marker Recognition and Tracking for Motion Image