Abstract:With the rapid development of artificial intelligence and computer vision technology, autonomous driving technology has become a hot area of concern. The driving scenarios of autonomous vehicles can be divided into structured scenarios and unstructured scenarios. Compared with structured scenes, unstructured road scenes lack the constraints of lane lines and traffic rules, and the safety awareness of traffic participants is weaker. Therefore, there are new and higher requirements for the environment perception tasks of autonomous vehicles in unstructured road scenes. The current research rarely integrates the target detection and road segmentation to achieve the simultaneous processing of target detection and road segmentation of autonomous vehicle in unstructured road scenes. Aiming at the above issues, a multitask model for object detection and road segmentation in unstructured road scenes is proposed. Through the sharing and fusion of the object detection model and road segmentation model, multitask model can complete the tasks of multi-object detection and road segmentation in unstructured road scenes while inputting a picture. Firstly, MobileNetV2 is used to replace the backbone network of YOLOv5, and multi-scale feature fusion is used to realize the information exchange layer between different features. Subsequently, a road segmentation model was designed based on the DeepLabV3+ algorithm. Its main feature is that it uses MobileNetV2 as the backbone network and combines the binary classification focus Loss function for network optimization. Then, we fused the object detection algorithm and road segmentation algorithm based on the shared MobileNetV2 network to obtain a multitask model and trained it on both the public dataset and the self-built dataset NJFU. The training results demonstrate that the multitask model significantly enhances the algorithm's execution speed by approximately 10 FPS while maintaining the accuracy of object detection and road segmentation. Finally, we conducted validation of the multitask model on an actual vehicle.

One for All: A Mutual Enhancement Method for Object Detection and Semantic Segmentation

In Defense Of Multi-Source Omni-Supervised Efficient Convnet For Robust Semantic Segmentation In Heterogeneous Unseen Domains

A Joint Object Detection and Semantic Segmentation Model with Cross-Attention and Inner-Attention Mechanisms

Object-Based Augmentation Improves Quality of Remote Sensing Semantic Segmentation

Diverse Generation while Maintaining Semantic Coordination: A Diffusion-Based Data Augmentation Method for Object Detection

One for All: Toward Unified Foundation Models for Earth Vision

A Data Augmentation Method Based on Multi-Modal Image Fusion for Detection and Segmentation

Multiscale Semantic Fusion-Guided Fractal Convolutional Object Detection Network for Optical Remote Sensing Imagery

Once-for-All: Train One Network and Specialize it for Efficient Deployment

Adaptive Context- and Scale-Aware Aggregation with Feature Alignment for One-Shot Object Detection.

Occlusion-Free Road Segmentation Leveraging Semantics for Autonomous Vehicles

Data Augmentation Based on Cannikin Law for Object Detection

AFANet: A Multibackbone Compatible Feature Fusion Framework for Effective Remote Sensing Object Detection

Semantic-aligned Fusion Transformer for One-shot Object Detection

Convolutional Neural Networks-Based Object Detection Algorithm by Jointing Semantic Segmentation for Images

AOP-Net: All-in-One Perception Network for Joint LiDAR-based 3D Object Detection and Panoptic Segmentation

Multi-Modal Object Detection Method Based on Dual-Branch Asymmetric Attention Backbone and Feature Fusion Pyramid Network

Research on multitask model of object detection and road segmentation in unstructured road scenes

An Adaptive Attention Fusion Mechanism Convolutional Network for Object Detection in Remote Sensing Images

Fewer is more: efficient object detection in large aerial images

OneFormer3D: One Transformer for Unified Point Cloud Segmentation