Multi-sensor Augmented Reality Tracking Based on Robot Hand-Eye Calibration

yang zhang,lin li,ya zhou,tao su,jintao ma,xiaoming hu
DOI: https://doi.org/10.1007/978-3-642-27866-2_7
2012-01-01
Abstract:Calibration of coordinate systems between cameras and world coordinate system is of key importance in augmented reality. In this paper, a multi-sensor mechanical tracking method is proposed based on robot hand-eye calibration. The original camera pose estimation is obtained using computer vision algorithm by improved orthogonal iteration. In tracking process, the camera extrinsic parameters, i.e. rotation and translation matrixes are got by rotary angles of sensors mounted on the multi-arm mechanical system. Users can observe augmented scene on the video see-through display set on the end of the arms and move in six degree of freedom by linkage motion. The tracking accuracy and test application are presented.
What problem does this paper attempt to address?