Abstract:In such application of VR to teleoperation, the most important thing is to keep the virtual environment consistent with the real environment as most of the operating time. If this can be ensured, a good part of practical teleoperation can be performed in an automatic way. Following this idea, we have developed a model-based dynamic calibration algorithm for the consistency of the two environments. First, model of the real environment is created by moving a camera through the environment. We use multi-position-based stereo vision technique. In the process of rehearsal, path is planned by the operator for a specific task. In such case, places that have complex structures for teleoperation such as turning corners, narrow spaces, etc. are defined as key positions by the operator, where local landmarks are set for later dynamic calibration. During practical teleoperation, the robot moves through the planned paths for all the areas except the selected key positions. At key positions, 3D positions of the robot are calibrated by matching features of the landmarks in the images and their corresponding features in the models interactively. Errors detected between the virtual and real environments are recorded to amend the planned path for the coming robot movements. When the robot is approaching near the target, it will be difficult for the operator to determine accurate position of the target in teleoperation. We propose and implement a marker-based algorithm for automatic location of the target at such case. Preliminary experiments have been carried out using a setup consisting of a 4 DOF movable platform, a camera and a laser gun mounted on the platform. Several small cubes are used as landmarks and placed in a room-like environment with several polyhedrons as obstacles. The target is a laser-light-receiver placed inside a small hole on a planar surface of arbitrary pose. The task is to shoot a laser beam from the laser gun into the receiver. The experimental result was quite satisfactory.

A Human-Assisted Based Visual Servo Approach For Tele-Assembly

A Motion Planning Method for Visual Servoing Using Deep Reinforcement Learning in Autonomous Robotic Assembly

A Hybrid Visual Servo Control Method for Simultaneously Controlling a Nonholonomic Mobile and a Manipulator.

Visual Servoing with an Uncalibrated Eye-in-hand Camera

Teleoperation with automatic posture regulation and broad learning control for assembly tasks

Markless Visual Servoing for 3C Product Assembly with Quotient Kinematics Manipulator

Robot teleoperation using a vision-based manipulation method

Global Visual Servoing of Miniature Mobile Robot Inside a Micro-Assembly Station

A real-time explicit mapping and teleoperation control method for humanoid robots with posture constraints

Image-Based Visual Servoing for Enhanced Cooperation of Dual-Arm Manipulation

Large gear structure assembly method based on uncalibrated image visual servo guidance

Vision-based posture-consistent teleoperation of robotic arm using multi-stage deep neural network

An Integrated Vision-Based System for Efficient Robot Arm Teleoperation

A Robotic Teleoperation System for Precise Robotic Manipulation by Human-Machine Interaction

Using Virtual Environment to Aid Teleoperation

Non-vector Space Visual Servoing for Multiple Pin-in-hole Assembly by Robot

Robot manipulator using a vision-based human – manipulator interface 1

Automatic precision robot assembly system with microscopic vision and force sensor

Adaptive Visual Servoing Using Point and Line Features With an Uncalibrated Eye-in-Hand Camera

Learning Autonomous Viewpoint Adjustment from Human Demonstrations for Telemanipulation

High-Precision Monocular Vision Guided Robotic Assembly Based on Local Pose Invariance