Abstract:Neural network based methods for fisheye distortion correction are effective and increasingly popular, although training network require a high amount of labeled data. In this paper, we propose an unsupervised fisheye correction network to address the aforementioned issue. During the training process, the predicted parameters are employed to correct strong distortion that exists in the fisheye image and synthesize the corresponding distortion using the original distortion-free image. Thus, the network is constrained with bidirectional loss to obtain more accurate distortion parameters. We calculate the two losses at the image level as opposed to directly minimizing the difference between the predicted and ground truth of distortion parameters. Additionally, we leverage the geometric prior that the distortion distribution depends on the geometric regions of fisheye images and the straight line should be straight in the corrected images. The network focuses more on the geometric prior regions as opposed to equally perceiving the whole image without any attention mechanisms. To generate more appealing corrected results in visual appearance, we introduce a coarse-to-fine inpainting network to fill the hole regions caused by the irreversible mapping function using distortion parameters. Each module of the proposed network is differentiable, and thus the entire framework is completely end-to-end. When compared with the previous supervised methods, our method is more flexible and shows better practical applications for distortion rectification. The experiment results demonstrate that our proposed method outperforms state-of-the-art methods on the correction performance without any labeled distortion parameters.

Adversarial Training-Based Hard Example Mining for Pedestrian Detection in Fish-Eye Images

An adversarial pedestrian detection model based on virtual fisheye image training

Few-Shot Supervised Prototype Alignment for Pedestrian Detection on Fisheye Images

MTHM: Self-Supervised Multitask Anomaly Detection with Hard Example Mining

PPD: A New Valet Parking Pedestrian Fisheye Dataset for Autonomous Driving

FishEyeRecNet: A Multi-Context Collaborative Deep Network for Fisheye Image Rectification.

Accurate Fish Detection under Marine Background Noise Based on the Retinex Enhancement Algorithm and CNN

Key point calibrating and clustering for hard example mining of dense analogs in the fish-eye lens

Hard Adversarial Example Mining for Improving Robust Fairness

A Detection and Tracking System for Fisheye Videos from Traffic Intersections

Loss Rank Mining: A General Hard Example Mining Method for Real-time Detectors

FishEye8K: A Benchmark and Dataset for Fisheye Camera Object Detection

Reflective Adversarial Attacks against Pedestrian Detection Systems for Vehicles at Night

Source-Free Unsupervised Cross-Domain Pedestrian Detection via Pseudo Label Mining and Screening

ADS-detector: An attention-based dual stream adversarial example detection method

Unsupervised Fisheye Image Correction Through Bidirectional Loss with Geometric Prior

Adversarial Examples Detection with Enhanced Image Difference Features based on Local Histogram Equalization

FisheyePP4AV: A privacy-preserving method for autonomous vehicles on fisheye camera images

Intelligent Video Analysis: A Pedestrian Trajectory Extraction Method for the Whole Indoor Space Without Blind Areas

Adversarial Examples in Visual Object Tracking in Satellite Videos: Cross-Frame Momentum Accumulation for Adversarial Examples Generation

Training Region-Based Object Detectors with Online Hard Example Mining