Fisheye lens distortion correction using spherical perspective projection constraint

Xianghua Ying,Hu Zhan yi
2003-01-01
Jisuanji Xuebao/Chinese Journal of Computers
Abstract:Fisheye lenses are often used to enlarge the field of view of a camera. But the images taken with the fisheye camera often have severe distortions. This paper proposes a new fisheye lenses distortion correction method using spherical perspective projection (SPP) constraint. Space line are generally projected into curves on a fisheye image. The SPP constraint means that a space line must be projected into a great circle on a unit sphere under the SPP model. The reason of using the SPP model is to handle the situation of larger-than-180-degree view-angles, and our case happens to be true. Our proposed distortion correction process consists of the following two main steps: Firstly, polynomial models for radial and tangential distortions with free parameters are selected; Secondly, these parameters are estimated based on the fact that the projected image curves of space lines should be mapped to great circles on a unit spherical surface, i.e., the SPP constraint. By minimizing the sum of errors, the squares of spherical distances points to their corresponding best-fit great circles, the parameters are obtained. Our minimization process also consists of two steps, first, an initial estimation is obtained by the linearization of the two distortion models, then Levenberg-Marquardt algorithm is employed for the final nonlinear optimization. Finally, experimental results with synthetic data under different noise levels as well as with real fisheye images are reported, and the results appear satisfactory.
What problem does this paper attempt to address?