HoughLaneNet: Lane Detection with Deep Hough Transform and Dynamic Convolution

Jia-Qi Zhang,Hao-Bin Duan,Jun-Long Chen,Ariel Shamir,Miao Wang

2023-07-07

Abstract:The task of lane detection has garnered considerable attention in the field of autonomous driving due to its complexity. Lanes can present difficulties for detection, as they can be narrow, fragmented, and often obscured by heavy traffic. However, it has been observed that the lanes have a geometrical structure that resembles a straight line, leading to improved lane detection results when utilizing this characteristic. To address this challenge, we propose a hierarchical Deep Hough Transform (DHT) approach that combines all lane features in an image into the Hough parameter space. Additionally, we refine the point selection method and incorporate a Dynamic Convolution Module to effectively differentiate between lanes in the original image. Our network architecture comprises a backbone network, either a ResNet or Pyramid Vision Transformer, a Feature Pyramid Network as the neck to extract multi-scale features, and a hierarchical DHT-based feature aggregation head to accurately segment each lane. By utilizing the lane features in the Hough parameter space, the network learns dynamic convolution kernel parameters corresponding to each lane, allowing the Dynamic Convolution Module to effectively differentiate between lane features. Subsequently, the lane features are fed into the feature decoder, which predicts the final position of the lane. Our proposed network structure demonstrates improved performance in detecting heavily occluded or worn lane images, as evidenced by our extensive experimental results, which show that our method outperforms or is on par with state-of-the-art techniques.

Computer Vision and Pattern Recognition,Machine Learning

What problem does this paper attempt to address?

The problem that this paper attempts to solve is the challenge of lane detection in complex scenarios. Specifically, lane detection is a very important task in the field of autonomous driving, because it helps to adjust the driving direction, maintain cruise stability, and ensure safety through lane - keeping assist, departure warning and center - line - based lateral control technologies. However, there are many challenges in the actual road environment, such as worn - out lane lines, discontinuous lane lines and lane lines under extreme lighting conditions, all of which make lane detection difficult. In addition, current methods perform poorly in handling lane detection in complex environments, especially when dealing with severe occlusion or weak visual features.

To address these challenges, the paper proposes HoughLaneNet, a deep neural network model that combines the Deep Hough Transform (DHT) and the Dynamic Convolution Module. The main contributions of this model include:

1. **Hierarchical Deep Hough Transform**: Utilizing the geometric prior knowledge that lane lines are mainly straight lines, the local features in the image are mapped to the parameter space through the Hough transform, thereby effectively aggregating global features and making instance proposals.

2. **Optimized Lane Instance Selection Method and Dynamic Convolution Module**: An optimized lane instance selection method and a dynamic convolution module are introduced to improve the effect of lane segmentation and reduce the residual error in the ground - truth Hough map through the Reverse Hough Transform Loss.

3. **Extensive Experimental Verification**: Through a large number of experiments on three benchmark datasets (TuSimple, CULane and LLAMAS), it is proved that the proposed model achieves state - of - the - art performance in the lane detection task.

Through these innovative methods, the paper aims to improve the robustness and accuracy of lane detection in complex scenarios, especially when dealing with severely occluded, worn - out or lane lines with weak visual features.