Abstract:Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, Ahead of Print. The automated valet parking (AVP) based on the around view monitor (AVM) has attracted increasing attention from the research community due to its high practicality and low cost. However, the distortion correction and inverse perspective transformation of the around view images result in the truncated and deformed objects, which leads to poor detection performance. To address this problem, we propose a method of object ground lines regression and mapping from fisheye images to around view images. There are two key steps for the proposed method, regressing ground lines in the fisheye images and mapping ground lines to the around view image. To detect the objects and regress ground lines at the same time, we explored three new detectors based on YOLOv5 (i.e. YOLOv5-VGG, YOLOv5-Point, and YOLOv5-Ratio). Among them, YOLOv5-VGG adds a VGG-based regression network behind YOLOv5, YOLOv5-Point directly adds a regression head to share the convolutional features, and YOLOv5-Ratio combines the 2D box and ground line to predict its ratios. After that, the ground lines from four different views are mapped and fused to the around view image. Additionally, to facilitate the study of the object detection in the around view image, a large-scale labeled dataset is established, which comprises 9828 fisheye images collected from typical indoor and outdoor parking lots. For each image, the 2D bounding boxes and ground lines of objects are carefully labeled. Experiments show that the YOLOv5-Ratio obtains the best performance and can effectively detect the truncated and deformed object in the around view image with the precision rate of 92.28% and recall rate of 85.09% on our collected dataset.

Streaming Object Detection on Fisheye Cameras for Automatic Parking

Object Detection and Localization in 3D Environment by Fusing Raw Fisheye Image and Attitude Data

Moving Object Detection Using an In-Vehicle Fish-Eye Camera

Real Time Detection Algorithm of Parking Slot Based on Deep Learning and Fisheye Image

Embedded Online Fish Detection and Tracking System Via YOLOv3 and Parallel Correlation Filter

Downside Hemisphere Object Detection and Localization of MAV by Fisheye Camera

Parking Spot Classification based on surround view camera system

ParkScape: A Large-Scale Fisheye Dataset for Parking Slot Detection and a Benchmark Method

Orientation-aware People Detection and Counting Method Based on Overhead Fisheye Camera

FisheyeMultiNet: Real-time Multi-task Learning Architecture for Surround-view Automated Parking System

FisheyeDetNet: 360° Surround view Fisheye Camera based Object Detection System for Autonomous Driving

Outdoor Parking Line Detection Based on Monocular Fisheye Camera

Automatic Parking Based on Bird's Eye View Cameras

Enhanced Parking Perception by Multi-Task Fisheye Cross-view Transformers

Surround-View Fisheye BEV-Perception for Valet Parking: Dataset, Baseline and Distortion-Insensitive Multi-Task Framework

Fisheye Object Detection Based on Standard Image Datasets with 24-Points Regression Strategy

Real-time Detection, Tracking, and Classification of Moving and Stationary Objects using Multiple Fisheye Images

A Detection and Tracking System for Fisheye Videos from Traffic Intersections

Semantic Mapping and Localization for Autonomous Indoor Parking Based on Human-readable Visual Landmark

Automatic Parking Based on a Bird's Eye View Vision System

Object ground lines regression and mapping from fisheye images to around view image for the AVP