Robot Stereo Vision Guidance System Based on Attention Mechanism

Long Yang,Nan Feng Xiao
DOI: https://doi.org/10.4028/www.scientific.net/amm.385-386.708
2013-01-01
Applied Mechanics and Materials
Abstract:Add attention mechanism into traditional robot stereo vision system, thus got the possible workpiece position quickly by saliency image, highly accelerate the computing process. First, to get the camera intrinsic matrix and extrinsic matrix, camera stereo calibration needed be done. Then use those parameter matrixes to rectify the newly captured images, disparity map can be got based on the OpenCV library, meanwhile, saliency image was computed by Itti algorithm. Workpiece spatial pose to left camera coordinates can be got with triangulation measurement principal. After a series of coordinates transformation workpiece spatial pose to world coordinates can be got. With the robot inverse solution function, the robot joint rotation angle can be got thus driver the robot to work. At last, experiment results show the effectiveness of this method.
What problem does this paper attempt to address?