Image-Aided LiDAR Extraction, Classification, and Characterization of Lane Markings from Mobile Mapping Data

Yi-Ting Cheng,Young-Ha Shin,Sang-Yeop Shin,Yerassyl Koshan,Mona Hodaei,Darcy Bullock,Ayman Habib
DOI: https://doi.org/10.3390/rs16101668
IF: 5
2024-05-09
Remote Sensing
Abstract:The documentation of roadway factors (such as roadway geometry, lane marking retroreflectivity/classification, and lane width) through the inventory of lane markings can reduce accidents and facilitate road safety analyses. Typically, lane marking inventory is established using either imagery or Light Detection and Ranging (LiDAR) data collected by mobile mapping systems (MMS). However, it is important to consider the strengths and weaknesses of both camera and LiDAR units when establishing lane marking inventory. Images may be susceptible to weather and lighting conditions, and lane marking might be obstructed by neighboring traffic. They also lack 3D and intensity information, although color information is available. On the other hand, LiDAR data are not affected by adverse weather and lighting conditions, and they have minimal occlusions. Moreover, LiDAR data provide 3D and intensity information. Considering the complementary characteristics of camera and LiDAR units, an image-aided LiDAR framework would be highly advantageous for lane marking inventory. In this context, an image-aided LiDAR framework means that the lane markings generated from one modality (i.e., either an image or LiDAR) are enhanced by those derived from the other one (i.e., either imagery or LiDAR). In addition, a reporting mechanism that can handle multi-modal datasets from different MMS sensors is necessary for the visualization of inventory results. This study proposes an image-aided LiDAR lane marking inventory framework that can handle up to five lanes per driving direction, as well as multiple imaging and LiDAR sensors onboard an MMS. The framework utilizes lane markings extracted from images to improve LiDAR-based extraction. Thereafter, intensity profiles and lane width estimates can be derived using the image-aided LiDAR lane markings. Finally, imagery/LiDAR data, intensity profiles, and lane width estimates can be visualized through a web portal that has been developed in this study. For the performance evaluation of the proposed framework, lane markings obtained through LiDAR-based, image-based, and image-aided LiDAR approaches are compared against manually established ones. The evaluation demonstrates that the proposed framework effectively compensates for the omission errors in the LiDAR-based extraction, as evidenced by an increase in the recall from 87.6% to 91.6%.
environmental sciences,geosciences, multidisciplinary,imaging science & photographic technology,remote sensing
What problem does this paper attempt to address?
The problems that this paper attempts to solve are as follows: In road safety analysis, the inventory records of lane markings are of great significance for reducing accidents. Most of the existing research uses a single camera or LiDAR (Light Detection and Ranging) unit in Mobile Mapping Systems (MMS) to extract lane markings within a limited research area. However, these methods have some limitations. For example, image data are easily affected by weather and lighting conditions, while LiDAR data lack color information and may not be able to detect temporary markings. In addition, most methods mainly focus on the extraction of lane markings on driving lanes, and less on the classification and feature description of lane markings. To solve these problems, this paper proposes an image - assisted LiDAR framework for extracting, classifying, and characterizing lane markings from mobile mapping data. The main contributions of this framework include: - Proposing an image - assisted LiDAR framework for the extraction, classification, and characterization of lane markings. - Identifying all lane markings (not limited to driving lanes) visible in image and LiDAR data. - Processing data from multiple imaging and LiDAR sensors on MMS. - Evaluating the performance of the proposed method on a longer road section using MMS equipped with multiple cameras and LiDAR units. - Developing a reporting mechanism for visualizing image and LiDAR data as well as the extracted lane markings and their features (such as the visibility conditions of lane markings, intensity profiles, and lane widths). By combining the advantages of image and LiDAR data, this framework aims to improve the accuracy and reliability of lane marking extraction, thereby better supporting road safety analysis.