Visual Servo Control with a Monocular Camera

Darren M. Dawson,Jian Chen

2005-01-01

Abstract:This Ph.D. dissertation describes visual servo control with a monocular camera. The body of the dissertation focuses on five areas of interest in monocular visual servo control and its applications: (i) adaptive homography-based visual servo tracking control, (ii) navigation function based visual servo control, (iii) homography-based visual servo tracking control of a wheeled mobile robot, (iv) vision-based wheeled mobile robots with a monocular fixed camera, and (v) an optimization-based approach for fusing image-based trajectory generation with position-based visual servo control. The theory developed in each of these sections is demonstrated through simulation or experimental results. In the first chapter, a homography-based adaptive visual servo controller is developed to enable a robot end-effector to track a desired Euclidean trajectory as determined by a sequence of images for both the camera-in-hand and fixed-camera configurations. To achieve the objectives, a Lyapunov-based adaptive control strategy is employed to actively compensate for the lack of unknown depth measurements and the lack of an object model. The error systems are constructed as a hybrid of pixel information and reconstructed Euclidean variables obtained by comparing the images and decomposing a homography relationship. Simulation results are provided to demonstrate the performance of the developed controller for the fixed camera configuration. In the second chapter, the mapping between the desired camera feature vector and the desired camera pose (i.e., the position and orientation) is investigated to develop a measurable image Jacobian-like matrix. An image-space path planner is then proposed to generate a desired image trajectory based on this measurable image Jacobian-like matrix and an image space navigation function (NF) (i.e., a special potential field function) while satisfying rigid body constraints. An adaptive, homography-based visual servo tracking controller is then developed to navigate the position and orientation of a camera held by the end-effector of a robot manipulator to a goal position and orientation along the desired image-space trajectory while ensuring the target points remain visible (i.e., the target points avoid self-occlusion and remain in the field-of-view (FOV)) under certain technical restrictions. (Abstract shortened by UMI.)