Abstract:In autonomous driving, 3D lane detection using monocular cameras is an important task for various downstream planning and control tasks. Recent CNN and Transformer approaches usually apply a two-stage scheme in the model design. The first stage transforms the image feature from a front image into a bird's-eye-view (BEV) representation. Subsequently, a sub-network processes the BEV feature map to generate the 3D detection results. However, these approaches heavily rely on a challenging image feature transformation module from a perspective view to a BEV representation. In our work, we present CurveFormer++, a single-stage Transformer-based method that does not require the image feature view transform module and directly infers 3D lane detection results from the perspective image features. Specifically, our approach models the 3D detection task as a curve propagation problem, where each lane is represented by a curve query with a dynamic and ordered anchor point set. By employing a Transformer decoder, the model can iteratively refine the 3D lane detection results. A curve cross-attention module is introduced in the Transformer decoder to calculate similarities between image features and curve queries of lanes. To handle varying lane lengths, we employ context sampling and anchor point restriction techniques to compute more relevant image features for a curve query. Furthermore, we apply a temporal fusion module that incorporates selected informative sparse curve queries and their corresponding anchor point sets to leverage historical lane information. In the experiments, we evaluate our approach for the 3D lane detection task on two publicly available real-world datasets. The results demonstrate that our method provides outstanding performance compared with both CNN and Transformer based methods. We also conduct ablation studies to analyze the impact of each component in our approach.

BSNet: Lane Detection via Draw B-spline Curves Nearby

CurveLane-NAS: Unifying Lane-Sensitive Architecture Search and Adaptive Point Blending

Rethinking Efficient Lane Detection via Curve Modeling

Decoupling the Curve Modeling and Pavement Regression for Lane Detection

Multi-dimensional Search with Strip Convolution and R-Squared Loss for Lane Detection

A novel curve lane detection based on Improved River Flow and RANSA

ElasticLaneNet: An Efficient Geometry-Flexible Approach for Lane Detection

SpinNet: Spinning Convolutional Network for Lane Boundary Detection

Sketch and Refine: Towards Fast and Accurate Lane Detection

Shallow Detail and Semantic Segmentation Combined Bilateral Network Model for Lane Detection

CurveFormer++: 3D Lane Detection by Curve Propagation with Temporal Curve Queries and Attention

Improved River Flow and Random Sample Consensus for Curve Lane Detection

Curve-based lane estimation model with lightweight attention mechanism

LaneNet: Real-Time Lane Detection Networks for Autonomous Driving

CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolution

3D Lane Detection from Front or Surround-View using Joint-Modeling & Matching

Lane Detection Based on a Lightweight Convolutional Neural Network

MPR-Net: Multi-Scale Key Points Regression for Lane Detection

RS-Lane: A Robust Lane Detection Method Based on ResNeSt and Self-Attention Distillation for Challenging Traffic Situations

Efficient Lane Boundary Detection with Spatial-Temporal Knowledge Filtering.

BezierFormer: A Unified Architecture for 2D and 3D Lane Detection