A Fast and Accurate Lane Detection Method Based on Row Anchor and Transformer Structure

Yuxuan Chai,Shixian Wang,Zhijia Zhang

DOI: https://doi.org/10.3390/s24072116

IF: 3.9

2024-03-27

Sensors

Abstract:Lane detection plays a pivotal role in the successful implementation of Advanced Driver Assistance Systems (ADASs), which are essential for detecting the road's lane markings and determining the vehicle's position, thereby influencing subsequent decision making. However, current deep learning-based lane detection methods encounter challenges. Firstly, the on-board hardware limitations necessitate an exceptionally fast prediction speed for the lane detection method. Secondly, improvements are required for effective lane detection in complex scenarios. This paper addresses these issues by enhancing the row-anchor-based lane detection method. The Transformer encoder–decoder structure is leveraged as the row classification enhances the model's capability to extract global features and detect lane lines in intricate environments. The Feature-aligned Pyramid Network (FaPN) structure serves as an auxiliary branch, complemented by a novel structural loss with expectation loss, further refining the method's accuracy. The experimental results demonstrate our method's commendable accuracy and real-time performance, achieving a rapid prediction speed of 129 FPS (the single prediction time of the model on RTX3080 is 15.72 ms) and a 96.16% accuracy on the Tusimple dataset—a 3.32% improvement compared to the baseline method.

engineering, electrical & electronic,chemistry, analytical,instruments & instrumentation

What problem does this paper attempt to address?

### Problems the Paper Attempts to Solve

This paper aims to address two major challenges faced by lane detection in Advanced Driver Assistance Systems (ADAS):

1. **Real-time performance requirements**: The limitations of in-vehicle hardware demand extremely high prediction speeds for lane detection methods.
2. **Effectiveness in complex scenarios**: Existing deep learning-based methods need to improve the effectiveness of lane detection in low-light environments, strong lighting, or when markings are blurred.

To tackle these challenges, the paper proposes an improved row-anchor-based lane detection method. Specifically, this method combines a Transformer encoder-decoder structure to enhance the model's ability to extract global features and accurately detect lane lines in complex environments. Additionally, the method introduces an auxiliary branch—the Feature-aligned Pyramid Network (FaPN)—and further improves detection accuracy through a new structural loss and expectation loss. Experimental results show that this method not only achieves high accuracy (96.16% on the Tusimple dataset) but also realizes fast prediction speeds (129 FPS).