Abstract:Neural network based methods for fisheye distortion correction are effective and increasingly popular, although training network require a high amount of labeled data. In this paper, we propose an unsupervised fisheye correction network to address the aforementioned issue. During the training process, the predicted parameters are employed to correct strong distortion that exists in the fisheye image and synthesize the corresponding distortion using the original distortion-free image. Thus, the network is constrained with bidirectional loss to obtain more accurate distortion parameters. We calculate the two losses at the image level as opposed to directly minimizing the difference between the predicted and ground truth of distortion parameters. Additionally, we leverage the geometric prior that the distortion distribution depends on the geometric regions of fisheye images and the straight line should be straight in the corrected images. The network focuses more on the geometric prior regions as opposed to equally perceiving the whole image without any attention mechanisms. To generate more appealing corrected results in visual appearance, we introduce a coarse-to-fine inpainting network to fill the hole regions caused by the irreversible mapping function using distortion parameters. Each module of the proposed network is differentiable, and thus the entire framework is completely end-to-end. When compared with the previous supervised methods, our method is more flexible and shows better practical applications for distortion rectification. The experiment results demonstrate that our proposed method outperforms state-of-the-art methods on the correction performance without any labeled distortion parameters.

Self-Supervised Deep Learning for Fisheye Image Rectification.

FishEyeRecNet: A Multi-Context Collaborative Deep Network for Fisheye Image Rectification.

DaFIR: Distortion-aware Representation Learning for Fisheye Image Rectification

Unsupervised Fisheye Image Correction Through Bidirectional Loss with Geometric Prior

Estimating Radial Distortion for Fish-eye Lens Based on Collinear Constraint

SIR: Self-supervised Image Rectification Via Seeing the Same Scene from Multiple Different Lenses

SimFIR: A Simple Framework for Fisheye Image Rectification with Self-supervised Representation Learning

Object Detection and Localization in 3D Environment by Fusing Raw Fisheye Image and Attitude Data

DQN-based gradual fisheye image rectification

Downside Hemisphere Object Detection and Localization of MAV by Fisheye Camera

RoFIR: Robust Fisheye Image Rectification Framework Impervious to Optical Center Deviation

Linear fitting interpolation based on FOV division for correcting wide angle fish-eye lens distortion

Fish-eye image correction method and technique based on geometrical imaging model

Two distortion correcting methods for fisheye images

Adapting CNNs for Fisheye Cameras without Retraining

Progressively Complementary Network for Fisheye Image Rectification Using Appearance Flow

FisheyeDepth: A Real Scale Self-Supervised Depth Estimation Model for Fisheye Camera

Location-guided Head Pose Estimation for Fisheye Image

A Stronger Stitching Algorithm for Fisheye Images based on Deblurring and Registration

Pixel-variant Local Homography for Fisheye Stereo Rectification Minimizing Resampling Distortion

A Comprehensive Overview of Fish-Eye Camera Distortion Correction Methods