Abstract:This Ph.D. dissertation describes visual servo control with a monocular camera. The body of the dissertation focuses on five areas of interest in monocular visual servo control and its applications: (i) adaptive homography-based visual servo tracking control, (ii) navigation function based visual servo control, (iii) homography-based visual servo tracking control of a wheeled mobile robot, (iv) vision-based wheeled mobile robots with a monocular fixed camera, and (v) an optimization-based approach for fusing image-based trajectory generation with position-based visual servo control. The theory developed in each of these sections is demonstrated through simulation or experimental results. In the first chapter, a homography-based adaptive visual servo controller is developed to enable a robot end-effector to track a desired Euclidean trajectory as determined by a sequence of images for both the camera-in-hand and fixed-camera configurations. To achieve the objectives, a Lyapunov-based adaptive control strategy is employed to actively compensate for the lack of unknown depth measurements and the lack of an object model. The error systems are constructed as a hybrid of pixel information and reconstructed Euclidean variables obtained by comparing the images and decomposing a homography relationship. Simulation results are provided to demonstrate the performance of the developed controller for the fixed camera configuration. In the second chapter, the mapping between the desired camera feature vector and the desired camera pose (i.e., the position and orientation) is investigated to develop a measurable image Jacobian-like matrix. An image-space path planner is then proposed to generate a desired image trajectory based on this measurable image Jacobian-like matrix and an image space navigation function (NF) (i.e., a special potential field function) while satisfying rigid body constraints. An adaptive, homography-based visual servo tracking controller is then developed to navigate the position and orientation of a camera held by the end-effector of a robot manipulator to a goal position and orientation along the desired image-space trajectory while ensuring the target points remain visible (i.e., the target points avoid self-occlusion and remain in the field-of-view (FOV)) under certain technical restrictions. (Abstract shortened by UMI.)

A Monocular Visual Servoing Control System for Mobile Robot

Realization of odometry system using monocular vision

Robust uncalibrated visual stabilization for nonholonomic mobile robots

3D Depth Map Based Optimal Motion Control for Wheeled Mobile Robot

Visual Servo Control Of Unmanned Aerial Vehicles: An Object Tracking-Based Approach

Monocular Camera Visual Servo Control Of Wheeled Mobile Robots

An Object Localization System Using Monocular Camera and Two-Axis-Controlled Laser Ranging Sensor for Mobile Robot

Visual Stabilization of Wheeled Mobile Robots with Unknown Visual Parameters

Dynamic Object Recognition and Tracking of Mobile Robot by Monocular Vision

Depth-PC: A Visual Servo Framework Integrated with Cross-Modality Fusion for Sim2Real Transfer

Unified Tracking and Regulation Visual Servoing of Wheeled Mobile Robots with Euclidean Reconstruction.

A hybrid visual servoing control of 4 DOFs space robot

Switching control for homography-based mobile robot visual servoing

Visual Tracking and Depth Estimation of Mobile Robots Without Desired Velocity Information.

A Fuzzy Approach to Visual Servoing with A Bagging Method for Wheeled Mobile Robot

Object Pickup Manipulation Control of A Mobile Robotic System Based on Monocular Vision

Navigation Control Method of Indoor Mobile Robot Based on Visual Servo

Visual Servo Control with a Monocular Camera

Monocular Vision Navigation and Control of Mobile Robot

Vision System of Mobile Robot Combining Binocular and Depth Cameras

Automatic Micro-manipulation Based on Visual Servoing