Abstract:Monocular 3-D object detection is a challenging and important task in autonomous driving. In 3-D object detection, depth information are crucial for determining the position, size, and posture of objects. However, in the 2-D images obtained by monocular cameras, depth information are compressed into a plane, which blurs the relative position and size relationships between objects. In addition, the pose changes of objects in 3-D space (such as rotation and tilt) can cause changes in their projected shape, size, and position in 2-D images, which increases the difficulty of detecting 3-D objects from monocular 2-D images. In this article, we propose a depth-vision-decoupled transformer for monocular multiclass 3-D object detection. The proposed scheme is constructed with the following novel components: 1) a cascaded group-multiscale convolutional attention (CG-MSCA) with multiscale-perception and direction-perception capabilities to focus on the local characteristics of the complex scene; 2) a decoupled-feature-aware transformer (DFTR) module, which globally decouples depth and visual features, encodes and decodes them separately to avoid the monocularly estimated inaccurate depth interfering with the model's learning of visual information and alleviate the mismatch between stereo information and geometric shape of the object; and 3) a cross-attention-guided fusion module (CAFM) to rationalize the fusion of decoupled depth and visual features before prediction. Experiments on the KITTI, DAIR-V2X-V, and DAIR-V2X-I datasets show that our proposed method produces competitive performance compared with Transformer-based methods and other state-of-the-art (SOTA) methods. For the Car Category, our method achieves 17.04% average precision of 3-D ( ) for the moderate setting (the most important setting) of the KITTI dataset with an intersection over union (IoU) threshold of 0.7.

Enhancing Monocular 3-D Object Detection Through Data Augmentation Strategies

Exploring 2D Data Augmentation for 3D Monocular Object Detection

Leveraging Front and Side Cues for Occlusion Handling in Monocular 3D Object Detection

MT-SSD: Single-Stage 3D Object Detector Based on Magnification Transformation

Improving 3D Object Detection through Progressive Population Based Augmentation

Performance Enhancement Using Data Augmentation of Point Cloud Based 3D Object Detection for Autonomous Driving

Augmenting 3-D Object Detection Through Data Uncertainty-Driven Auxiliary Framework

Every Dataset Counts: Scaling up Monocular 3D Object Detection with Joint Datasets Training

Exploring Data Augmentation for Multi-Modality 3D Object Detection

3D Data Augmentation for Driving Scenes on Camera

Augment and Criticize: Exploring Informative Samples for Semi-Supervised Monocular 3D Object Detection

Quantifying Data Augmentation for LiDAR based 3D Object Detection

False Positive Sampling-based Data Augmentation for Enhanced 3D Object Detection Accuracy

Aug3D-RPN: Improving Monocular 3D Object Detection by Synthetic Images with Virtual Depth

Depth-Vision-Decoupled Transformer With Cascaded Group Convolutional Attention for Monocular 3-D Object Detection

MonoAux: Fully Exploiting Auxiliary Information and Uncertainty for Monocular 3D Object Detection

ODM3D: Alleviating Foreground Sparsity for Semi-Supervised Monocular 3D Object Detection

How Important are Data Augmentations to Close the Domain Gap for Object Detection in Orbit?

SGM3D: Stereo Guided Monocular 3D Object Detection

Semi-Supervised 3D Object Detection with Channel Augmentation using Transformation Equivariance

Reinforced Axial Refinement Network for Monocular 3D Object Detection