Abstract:This research addresses the need for high-definition (HD) maps for autonomous vehicles (AVs), focusing on road lane information derived from aerial imagery. While Earth observation data offers valuable resources for map creation, specialized models for road lane extraction are still underdeveloped in remote sensing. In this study, we perform an extensive comparison of twelve foundational deep learning-based semantic segmentation models for road lane marking extraction from high-definition remote sensing images, assessing their performance under transfer learning with partially labeled datasets. These models were fine-tuned on the partially labeled Waterloo Urban Scene dataset, and pre-trained on the SkyScapes dataset, simulating a likely scenario of real-life model deployment under partial labeling. We observed and assessed the fine-tuning performance and overall performance. Models showed significant performance improvements after fine-tuning, with mean IoU scores ranging from 33.56% to 76.11%, and recall ranging from 66.0% to 98.96%. Transformer-based models outperformed convolutional neural networks, emphasizing the importance of model pre-training and fine-tuning in enhancing HD map development for AV navigation.

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the need to create high - definition maps (HD maps) for autonomous vehicles (AVs), especially the need to extract road lane information from aerial images. Specifically, the research aims to improve the accuracy of extracting road lane markings from high - resolution remote - sensing images by comparing the transfer - learning performance of deep - learning - based semantic segmentation models on partially - labeled datasets. ### Problem Background 1. **The Need for High - Definition Maps**: - The rapid development of autonomous driving technology has made high - definition maps crucial for ensuring the safe and efficient operation of AVs. - These maps need to provide precise environmental details, such as traffic signals, road features, and lane markings, to support the accurate navigation of AVs. 2. **Limitations of Existing Methods**: - Although Earth observation data (such as LiDAR and satellite images) are valuable for map creation, they have problems such as uneven point distribution and low spatial resolution. - Traditional remote - sensing methods are still under - developed in terms of lane - marking extraction, especially in dense urban environments. 3. **Advantages of Aerial Images**: - Aerial images obtained using drones or UAVs have higher resolution and wider coverage and can capture lane markings more effectively. - Integrating AI and deep - learning technologies can automate the processing of these data and extract key features, but still faces challenges. ### Research Objectives To fill this gap, the research carried out the following work: - **Model Comparison**: Evaluated the performance of 12 deep - learning - based semantic segmentation models in extracting road lane markings from aerial images. - **Transfer Learning**: Used a partially - labeled dataset for transfer learning to simulate the partially - labeled scenarios of model deployment in real - life. - **Performance Evaluation**: Evaluated the fine - tuning performance and overall performance of these models on two datasets, SkyScapes and Waterloo Urban Scene. ### Main Findings - **Performance Improvement**: After fine - tuning, the performance of the models improved significantly, with mIoU scores ranging from 33.56% to 76.11% and recall rates from 66.0% to 98.96%. - **Advantages of Transformer Models**: Transformer - based models outperformed convolutional neural networks (CNN), highlighting the importance of pre - training and fine - tuning in enhancing HD map development. In conclusion, this research aims to provide benchmarks and guidance for the development of high - definition maps for autonomous vehicles through systematic model comparison and performance evaluation.

Advancements in Road Lane Mapping: Comparative Fine-Tuning Analysis of Deep Learning-based Semantic Segmentation Methods Using Aerial Imagery

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

Lane-DeepLab: Lane Semantic Segmentation in Automatic Driving Scenarios for High-Definition Maps

Applying Unsupervised Semantic Segmentation to High-Resolution UAV Imagery for Enhanced Road Scene Parsing

DeepAerialMapper: Deep Learning-based Semi-automatic HD Map Creation for Highly Automated Vehicles

An Improved Deeplabv3+ Model for Semantic Segmentation of Urban Environments Targeting Autonomous Driving

Fine-Grained Off-Road Semantic Segmentation and Mapping via Contrastive Learning

Advancements in 3D Lane Detection Using LiDAR Point Clouds: From Data Collection to Model Development

Automatic extraction and 3D modeling of real road scenes using UAV imagery and deep learning semantic segmentation

Semantic segmentation of remote sensing imagery for road extraction via joint angle prediction: comparisons to deep learning

A Semi-Supervised Domain Adaptive Learning Approach to Unstructured Road Region Semantic Segmentation for Greenhouse Robots

Building Lane-Level Maps from Aerial Images

FusionLane: Multi-Sensor Fusion for Lane Marking Semantic Segmentation Using Deep Neural Networks

A Comparative Review on Enhancing Visual Simultaneous Localization and Mapping with Deep Semantic Segmentation

Road Segmentation in SAR Satellite Images with Deep Fully-Convolutional Neural Networks

Visual Semantic Localization based on HD Map for Autonomous Vehicles in Urban Scenarios

Augmenting Lane Perception and Topology Understanding with Standard Definition Navigation Maps

A comprehensive research of deep learning approaches for High Definition map construction in autonomous driving

Semantic Segmentation-Based Lane-Level Localization Using Around View Monitoring System

A Review of Deep Learning-Based Methods for Road Extraction from High-Resolution Remote Sensing Images