MARL-based calibration for cameras with large FOV

Xinyu Yang,Fuhan Chen,Jingwen Jiang,Hui Xie,Qiaofeng Ou
DOI: https://doi.org/10.1080/09500340.2024.2394959
IF: 1.3
2024-08-31
Journal of Modern Optics
Abstract:Achieving high-precision measurements in a large field of view (FOV) is a challenging task. The accuracy of vision measurements is determined by the quality of camera calibration, which is influenced by the pose of the target. To obtain suitable target pose, a target pose optimization method based on multi-agent reinforcement learning (MARL) is proposed. Firstly, the target pose optimization problem is modelled as a Markov decision process (MDP). Secondly, a multi-agent proximal policy optimization (MAPPO) algorithm for target pose optimization is designed by parameter sharing mechanism. Finally, optimization algorithm is adopted to camera calibration process. The calibration experiment was carried out under the large FOV of 4600 mm × 2300 mm. The results show that the back-projection error was 0.198 mm, the relative error of the diagonal length of target (505.847 mm) was 0.789 mm, and the success rate of large FOV camera calibration was 98.5%.
optics
What problem does this paper attempt to address?