Abstract:Monocular depth estimation is a task aimed at predicting pixel-level distances from a single RGB image. This task holds significance in various applications including autonomous driving and robotics. In particular, the recognition of surrounding environments is important to avoid collisions during autonomous parking. Fisheye cameras are adequate to acquire visual information from a wide field of view, reducing blind spots and preventing potential collisions. While there have been increasing demands for fisheye cameras in visual-recognition systems, existing research on depth estimation has primarily focused on pinhole camera images. Moreover, depth estimation from fisheye images poses additional challenges due to strong distortion and the lack of public datasets. In this work, we propose a novel underground parking lot dataset called JBNU-Depth360, which consists of fisheye camera images and their corresponding LiDAR projections. Our proposed dataset was composed of 4221 pairs of fisheye images and their corresponding LiDAR point clouds, which were obtained from six driving sequences. Furthermore, we employed a knowledge-distillation technique to improve the performance of the state-of-the-art depth-estimation models. The teacher–student learning framework allows the neural network to leverage the information in dense depth predictions and sparse LiDAR projections. Experiments were conducted on the KITTI-360 and JBNU-Depth360 datasets for analyzing the performance of existing depth-estimation models on fisheye camera images. By utilizing the self-distillation technique, the AbsRel and SILog error metrics were reduced by 1.81% and 1.55% on the JBNU-Depth360 dataset. The experimental results demonstrated that the self-distillation technique is beneficial to improve the performance of depth-estimation models.

Object Detection and Localization in 3D Environment by Fusing Raw Fisheye Image and Attitude Data

Downside Hemisphere Object Detection and Localization of MAV by Fisheye Camera

ObjectFusion: an Object Detection and Segmentation Framework with RGB-D SLAM and Convolutional Neural Networks

Orientation-aware People Detection and Counting Method Based on Overhead Fisheye Camera

3D Object Detection from a Single Fisheye Image Without a Single Fisheye Training Image

Omnidirectional Dense SLAM for Back-to-back Fisheye Cameras

Omnidirectional Depth Estimation With Hierarchical Deep Network for Multi-Fisheye Navigation Systems

FisheyeDepth: A Real Scale Self-Supervised Depth Estimation Model for Fisheye Camera

Real-time Detection, Tracking, and Classification of Moving and Stationary Objects using Multiple Fisheye Images

ℱ3-Net: Feature Fusion and Filtration Network for Object Detection in Optical Remote Sensing Images

Location-guided Head Pose Estimation for Fisheye Image

Real-Time Dense Mapping for Self-driving Vehicles using Fisheye Cameras

Autonomous Aerial Robot Using Dual-Fisheye Cameras.

Object Detection on Panoramic Images Based on Deep Learning

Monocular Depth Estimation from a Fisheye Camera Based on Knowledge Distillation

FisheyeDetNet: 360° Surround view Fisheye Camera based Object Detection System for Autonomous Driving

Fisheye Camera and Ultrasonic Sensor Fusion For Near-Field Obstacle Perception in Bird's-Eye-View

Neural Radiance Fields for Fisheye Driving Scenes Using Edge-Aware Integrated Depth Supervision

Low-Light Image Enhancement Framework for Improved Object Detection in Fisheye Lens Datasets

Disentangling and Vectorization: A 3D Visual Perception Approach for Autonomous Driving Based on Surround-View Fisheye Cameras

Streaming Object Detection on Fisheye Cameras for Automatic Parking