Real-time Detection, Tracking, and Classification of Moving and Stationary Objects using Multiple Fisheye Images

Iljoo Baek,Albert Davies,Geng Yan,Ragunathan,Rajkumar
DOI: https://doi.org/10.48550/arXiv.1803.06077
2018-08-31
Abstract:The ability to detect pedestrians and other moving objects is crucial for an autonomous vehicle. This must be done in real-time with minimum system overhead. This paper discusses the implementation of a surround view system to identify moving as well as static objects that are close to the ego vehicle. The algorithm works on 4 views captured by fisheye cameras which are merged into a single frame. The moving object detection and tracking solution uses minimal system overhead to isolate regions of interest (ROIs) containing moving objects. These ROIs are then analyzed using a deep neural network (DNN) to categorize the moving object. With deployment and testing on a real car in urban environments, we have demonstrated the practical feasibility of the solution. The video demos of our algorithm have been uploaded to Youtube: <a class="link-external link-https" href="https://youtu.be/vpoCfC724iA" rel="external noopener nofollow">this https URL</a>, <a class="link-external link-https" href="https://youtu.be/2X4aqH2bMBs" rel="external noopener nofollow">this https URL</a>
Computer Vision and Pattern Recognition
What problem does this paper attempt to address?