Abstract:In autonomous driving, 3D lane detection using monocular cameras is an important task for various downstream planning and control tasks. Recent CNN and Transformer approaches usually apply a two-stage scheme in the model design. The first stage transforms the image feature from a front image into a bird's-eye-view (BEV) representation. Subsequently, a sub-network processes the BEV feature map to generate the 3D detection results. However, these approaches heavily rely on a challenging image feature transformation module from a perspective view to a BEV representation. In our work, we present CurveFormer++, a single-stage Transformer-based method that does not require the image feature view transform module and directly infers 3D lane detection results from the perspective image features. Specifically, our approach models the 3D detection task as a curve propagation problem, where each lane is represented by a curve query with a dynamic and ordered anchor point set. By employing a Transformer decoder, the model can iteratively refine the 3D lane detection results. A curve cross-attention module is introduced in the Transformer decoder to calculate similarities between image features and curve queries of lanes. To handle varying lane lengths, we employ context sampling and anchor point restriction techniques to compute more relevant image features for a curve query. Furthermore, we apply a temporal fusion module that incorporates selected informative sparse curve queries and their corresponding anchor point sets to leverage historical lane information. In the experiments, we evaluate our approach for the 3D lane detection task on two publicly available real-world datasets. The results demonstrate that our method provides outstanding performance compared with both CNN and Transformer based methods. We also conduct ablation studies to analyze the impact of each component in our approach.

LaneFormer: An Efficient Transformer-based Network for Fast Lane Detection

A Fast and Accurate Lane Detection Method Based on Row Anchor and Transformer Structure

Sparse Laneformer

LLFormer: An Efficient and Real-time LiDAR Lane Detection Method based on Transformer

Efficient Lane Detection Technique Based on Lightweight Attention Deep Neural Network

ST-LaneNet: Lane Line Detection Method Based on Swin Transformer and LaneNet

End-to-end Lane Shape Prediction with Transformers

LDTR: Transformer-based Lane Detection with Anchor-chain Representation

Lightweight real-time lane detection algorithm based on ghost convolution and self batch normalization

PriorLane: A Prior Knowledge Enhanced Lane Detection Approach Based on Transformer

Lane Detection Transformer Based on Multi-frame Horizontal and Vertical Attention and Visual Transformer Module.

An Efficient Transformer for Simultaneous Learning of BEV and Lane Representations in 3D Lane Detection

LaneNet: Real-Time Lane Detection Networks for Autonomous Driving

Fast Lane Detection Based on Sparse Prediction

ENet-21: An Optimized light CNN Structure for Lane Detection

Efficient Multi-Lane Detection Based on Large-Kernel Convolution and Location

A Fast and Robust Lane Detection via Online Re-Parameterization and Hybrid Attention

Fast Lane Detection Based on Row Anchor Classification

End-to-End Lane detection with One-to-Several Transformer

CurveFormer++: 3D Lane Detection by Curve Propagation with Temporal Curve Queries and Attention

Traffic Lane Detection using FCN