Abstract:Roadside perception can greatly increase the safety of autonomous vehicles by extending their perception ability beyond the visual range and addressing blind spots. However, current state-of-the-art vision-based roadside detection methods possess high accuracy on labeled scenes but have inferior performance on new scenes. This is because roadside cameras remain stationary after installation and can only collect data from a single scene, resulting in the algorithm overfitting these roadside backgrounds and camera poses. To address this issue, in this paper, we propose an innovative Scenario Generalization Framework for Vision-based Roadside 3D Object Detection, dubbed SGV3D. Specifically, we employ a Background-suppressed Module (BSM) to mitigate background overfitting in vision-centric pipelines by attenuating background features during the 2D to bird's-eye-view projection. Furthermore, by introducing the Semi-supervised Data Generation Pipeline (SSDG) using unlabeled images from new scenes, diverse instance foregrounds with varying camera poses are generated, addressing the risk of overfitting specific camera poses. We evaluate our method on two large-scale roadside benchmarks. Our method surpasses all previous methods by a significant margin in new scenes, including +42.57% for vehicle, +5.87% for pedestrian, and +14.89% for cyclist compared to BEVHeight on the DAIR-V2X-I heterologous benchmark. On the larger-scale Rope3D heterologous benchmark, we achieve notable gains of 14.48% for car and 12.41% for large vehicle. We aspire to contribute insights on the exploration of roadside perception techniques, emphasizing their capability for scenario generalization. The code will be available at {\url{ https://github.com/yanglei18/SGV3D}}

Segment all roads: Domain generalized freespace detection by robust surface normal information embedding and edge-aware learning

From One To Many: Unsupervised Traversable Area Segmentation In Off-Road Environment

NLFNet: Non-Local Fusion Towards Generalized Multimodal Semantic Segmentation Across RGB-Depth, Polarization, and Thermal Images

Domain Generalization for Vision-based Driving Trajectory Generation

Unifying Terrain Awareness Through Real-Time Semantic Segmentation

SNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detection

Cross-Modality Domain Adaptation for Freespace Detection: A Simple Yet Effective Baseline

Drivable Area Segmentation in Unstructured Roads for Autonomous Vehicles Based on Multi-sensor Fusion.

Towards Scenario Generalization for Vision-based Roadside 3D Object Detection

SGV3D:Towards Scenario Generalization for Vision-based Roadside 3D Object Detection

Improving Synthetic to Realistic Semantic Segmentation with Parallel Generative Ensembles for Autonomous Urban Driving

Towards Full-scene Domain Generalization in Multi-agent Collaborative Bird's Eye View Segmentation for Connected and Autonomous Driving

DIRL: Domain-Invariant Representation Learning for Generalizable Semantic Segmentation

Domain-Incremental Learning for Remote Sensing Semantic Segmentation With Multifeature Constraints in Graph Space

A Semi-Supervised Domain Adaptive Learning Approach to Unstructured Road Region Semantic Segmentation for Greenhouse Robots

Scene-Adaptive 3-D Semantic Segmentation Method Based on Multiphase Edge Enhancement for Intelligent Vehicles

Spatial-Aware Learning in Feature Embedding and Classification for One-Stage 3-D Object Detection

Detecting Drivable Area for Self-driving Cars: An Unsupervised Approach

Road Segmentation with Image-LiDAR Data Fusion

Stagewise Unsupervised Domain Adaptation with Adversarial Self-Training for Road Segmentation of Remote Sensing Images

Restricted Deformable Convolution based Road Scene Semantic Segmentation Using Surround View Cameras