Abstract:The search for predictive models that generalize to the long tail of sensor inputs is the central difficulty when developing data-driven models for autonomous vehicles. In this paper, we use lane detection to study modeling and training techniques that yield better performance on real world test drives. On the modeling side, we introduce a novel fully convolutional model of lane detection that learns to decode lane structures instead of delegating structure inference to post-processing. In contrast to previous works, our convolutional decoder is able to represent an arbitrary number of lanes per image, preserves the polyline representation of lanes without reducing lanes to polynomials, and draws lanes iteratively without requiring the computational and temporal complexity of recurrent neural networks. Because our model includes an estimate of the joint distribution of neighboring pixels belonging to the same lane, our formulation includes a natural and computationally cheap definition of uncertainty. On the training side, we demonstrate a simple yet effective approach to adapt the model to new environments using unsupervised style transfer. By training FastDraw to make predictions of lane structure that are invariant to low-level stylistic differences between images, we achieve strong performance at test time in weather and lighting conditions that deviate substantially from those of the annotated datasets that are publicly available. We quantitatively evaluate our approach on the CVPR 2017 Tusimple lane marking challenge, difficult CULane datasets, and a small labeled dataset of our own and achieve competitive accuracy while running at 90 FPS.

Fast Lane Detection Based on Sparse Prediction

Short-Term Forecasting of Traffic Flow and Speed: A Deep Learning Approach

Fast Lane Detection Based on Row Anchor Classification

Fast lane detection for extracting spatial location information

Efficient Lane Detection Technique Based on Lightweight Attention Deep Neural Network

Fast Lane Detection Based on Attention Mechanism

A Fast and Accurate Lane Detection Method Based on Row Anchor and Transformer Structure

Fast and Accurate Lane Detection via Graph Structure and Disentangled Representation Learning

Fast Multi-Lane Detection Based on CNN Differentiation for ADAS/AD

A Fast and Robust Lane Detection via Online Re-Parameterization and Hybrid Attention

FastDraw: Addressing the Long Tail of Lane Detection by Adapting a Sequential Prediction Network

The Improved Deeplabv3plus Based Fast Lane Detection Method

Sparse Laneformer

RCLane: Relay Chain Prediction for Lane Detection

LaneFormer: An Efficient Transformer-based Network for Fast Lane Detection

Efficient Multi-Lane Detection Based on Large-Kernel Convolution and Location

SwiftLane: Towards Fast and Efficient Lane Detection

CondLaneNet: a Top-to-down Lane Detection Framework Based on Conditional Convolution

Sketch and Refine: Towards Fast and Accurate Lane Detection

A Fast Detection Method for Polynomial Fitting Lane with Self-attention Module Added

Efficient Road Lane Marking Detection with Deep Learning