Abstract:Deep learning based on labeled data has brought massive success in computer vision, speech recognition, and natural language processing. Nevertheless, labeled data is just a drop in the ocean compared with unlabeled data. How can people utilize the unlabeled data effectively? Research has focused on unsupervised and semi-supervised learning to solve such a problem. Some theoretical and empirical studies have proved that unlabeled data can help boost the generalization ability and robustness under adversarial attacks. However, current theoretical research on the relationship between robustness and unlabeled data limits its scope to toy datasets. Meanwhile, the visual models in autonomous driving need a significant improvement in robustness to guarantee security and safety. This paper proposes a semi-supervised learning framework for object detection in autonomous vehicles, improving the robustness with unlabeled data. Firstly, we build a baseline with the transfer learning of an unsupervised contrastive learning method—Momentum Contrast (MoCo). Secondly, we propose a semi-supervised co-training method to label the unlabeled data for retraining, which improves generalization on the autonomous driving dataset. Thirdly, we apply the unsupervised Bounding Box data augmentation (BBAug) method based on a search algorithm, which uses reinforcement learning to improve the robustness of object detection for autonomous driving. We present an empirical study on the KITTI dataset with diverse adversarial attack methods. Our proposed method realizes the state-of-the-art generalization and robustness under white-box attacks (DPatch and Contextual Patch) and black-box attacks (Gaussian noise, Rain, Fog, and so on). Our proposed method and empirical study show that using more unlabeled data benefits the robustness of perception systems in autonomous driving.

Semi-supervised vanishing point detection with contrastive learning

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

RVPNet: A real time unstructured road vanishing point detection algorithm using attention mechanism and global context information

An Iterative Semi-Supervised Approach with Pixel-wise Contrastive Loss for Road Extraction in Aerial Images

Heatmap-based Vanishing Point boosts Lane Detection

A Refined-Line-Based Method to Estimate Vanishing Points for Vision-Based Autonomous Vehicles

Vanishing-Point-Guided Video Semantic Segmentation of Driving Scenes

A weakly supervised method for 3D object detection with partially annotated samples

Prototype-Voxel Contrastive Learning for LiDAR Point Cloud Panoptic Segmentation

VPGNet: Vanishing Point Guided Network for Lane and Road Marking Detection and Recognition

Fine-Grained Off-Road Semantic Segmentation and Mapping via Contrastive Learning

D-VPnet: A Network for Real-time Dominant Vanishing Point Detection in Natural Scenes

Robust Object Detection for Autonomous Driving Based on Semi-Supervised Learning

SW-GAN: Road Extraction from Remote Sensing Imagery Using Semi-Weakly Supervised Adversarial Learning

VLM2Scene: Self-Supervised Image-Text-LiDAR Learning with Foundation Models for Autonomous Driving Scene Understanding

Cross-Modal Self-Supervised Learning with Effective Contrastive Units for LiDAR Point Clouds

Advancements in Road Lane Mapping: Comparative Fine-Tuning Analysis of Deep Learning-based Semantic Segmentation Methods Using Aerial Imagery

Mutual Guidance Meets Supervised Contrastive Learning: Vehicle Detection in Remote Sensing Images

3D Object Detection for Point Cloud in Virtual Driving Environment

Laser Point Cloud-Image Fusion Technology for Intelligent Driving Vehicles Based on Semi-Supervised Learning Algorithm