Abstract:Object detection and segmentation are two core modules of an autonomous vehicle perception system. They should have high efficiency and low latency while reducing computational complexity. Currently, the most commonly used algorithms are based on deep neural networks, which guarantee high efficiency but require high-performance computing platforms. In the case of autonomous vehicles, i.e. cars, but also drones, it is necessary to use embedded platforms with limited computing power, which makes it difficult to meet the requirements described above. A reduction in the complexity of the network can be achieved by using an appropriate: architecture, representation (reduced numerical precision, quantisation, pruning), and computing platform. In this paper, we focus on the first factor - the use of so-called detection-segmentation networks as a component of a perception system. We considered the task of segmenting the drivable area and road markings in combination with the detection of selected objects (pedestrians, traffic lights, and obstacles). We compared the performance of three different architectures described in the literature: MultiTask V3, HybridNets, and YOLOP. We conducted the experiments on a custom dataset consisting of approximately 500 images of the drivable area and lane markings, and 250 images of detected objects. Of the three methods analysed, MultiTask V3 proved to be the best, achieving 99% mAP_50 for detection, 97% MIoU for drivable area segmentation, and 91% MIoU for lane segmentation, as well as 124 fps on the RTX 3060 graphics card. This architecture is a good solution for embedded perception systems for autonomous vehicles. The code is available at: <a class="link-external link-https" href="https://github.com/vision-agh/MMAR_2023" rel="external noopener nofollow">this https URL</a>.

Global Image Segmentation Process using Machine Learning algorithm & Convolution Neural Network method for Self- Driving Vehicles

Autonomous Driving with Human Guided Image Feature Extraction

Vision-based Road Segmentation for Intelligent Vehicles using Deep Convolutional Neural Networks

Detection-segmentation convolutional neural network for autonomous vehicle perception

End to End Video Segmentation for Driving : Lane Detection For Autonomous Car

Vehicle Detection through Instance Segmentation using Mask R-CNN for Intelligent Vehicle System

Semantic Segmentation With Multi Scale Spatial Attention For Self Driving Cars

Explainable AI in Scene Understanding for Autonomous Vehicles in Unstructured Traffic Environments on Indian Roads Using the Inception U-Net Model with Grad-CAM Visualization

Monocular Camera Viewpoint-Invariant Vehicular Traffic Segmentation and Classification Utilizing Small Datasets

Proposing an Efficient Deep Learning Algorithm Based on Segment Anything Model for Detection and Tracking of Vehicles through Uncalibrated Urban Traffic Surveillance Cameras

A Multimodal Perception-Driven Self Evolving Autonomous Ground Vehicle

Semantic Segmentation and Depth Estimation of Urban Road Scene Images Using Multi-Task Networks

UnSegGNet: Unsupervised Image Segmentation using Graph Neural Networks

Real-time Joint Object Detection and Semantic Segmentation Network for Automated Driving

A Sim2Real Deep Learning Approach for the Transformation of Images from Multiple Vehicle-Mounted Cameras to a Semantically Segmented Image in Bird's Eye View

Smart Traffic Management of Vehicles using Faster R-CNN based Deep Learning Method

Vision-Based Obstacle Detection and Collision Prevention in Self-Driving Cars

Automatic Extraction of Relevant Road Infrastructure using Connected vehicle data and Deep Learning Model

Scene Detection Classification and Tracking for Self-Driven Vehicle

Object Detection for Self-Driving Car in Complex Traffic Scenarios

An Efficient Data Analytics and Optimized Algorithm for Enhancing the Performance of Image Segmentation Using Deep Learning Model