Abstract:Monocular 3D object detection aims to locate objects in different scenes with just a single image. Due to the absence of depth information, several monocular 3D detection techniques have emerged that rely on auxiliary depth maps from the depth estimation task. There are multiple approaches to understanding the representation of depth maps, including treating them as pseudo-LiDAR point clouds, leveraging implicit end-to-end learning of depth information, or considering them as an image input. However, these methods have certain drawbacks, such as their reliance on the accuracy of estimated depth maps and suboptimal utilization of depth maps due to their image-based nature. While LiDAR-based methods and convolutional neural networks (CNNs) can be utilized for pseudo point clouds and depth maps, respectively, it is always an alternative. In this paper, we propose a framework named the Adaptive Distance Interval Separation Network (ADISN) that adopts a novel perspective on understanding depth maps, as a form that lies between LiDAR and images. We utilize an adaptive separation approach that partitions the depth map into various subgraphs based on distance and treats each of these subgraphs as an individual image for feature extraction. After adaptive separations, each subgraph solely contains pixels within a learned interval range. If there is a truncated object within this range, an evident curved edge will appear, which we can leverage for texture extraction using CNNs to obtain rich depth information in pixels. Meanwhile, to mitigate the inaccuracy of depth estimation, we designed an uncertainty module. To take advantage of both images and depth maps, we use different branches to learn localization detection tasks and appearance tasks separately.

Automatic Segmentation of Human Depth Map Based on Semantic Segmentation of FCN and Depth Segmentation

A Depth Estimation Framework Based on Unsupervised Learning and Cross-Modal Translation

Binocular Depth Estimation Using Convolutional Neural Network With Siamese Branches.

Depth Map Inpainting Using a Fully Convolutional Network

A Cnn-Based Depth Estimation Approach With Multi-Scale Sub-Pixel Convolutions And A Smoothness Constraint

Depth Estimation of Supervised Monocular Images Based on Semantic Segmentation.

Enhanced Monocular Depth Estimation: A CNN Integrating Semantic Segmentation Embedding And Vanishing Point Detection

Understanding Depth Map Progressively: Adaptive Distance Interval Separation for Monocular 3d Object Detection

Human Segmentation Based on Disparity Map and GrabCut

Adaptive Semantic Fusion Framework for Unsupervised Monocular Depth Estimation

DeLS-3D: Deep Localization and Segmentation with a 3D Semantic Map

Human Segmentation by Geometrically Fusing Visible-Light and Thermal Imageries

Improving Video Segmentation by Fusing Depth Cues and the Visual Background Extractor (ViBe) Algorithm

Exploiting Depth from Single Monocular Images for Object Detection and Semantic Segmentation

Monocular Depth Estimation With Affinity, Vertical Pooling, And Label Enhancement

Real-Time Monocular Human Depth Estimation and Segmentation on Embedded Systems

Depth Segmentation in Real-World Scenes Based on U-V Disparity Analysis

Monocular Depth Estimation Based on Dilated Convolutions and Feature Fusion

Semantic 3D Mapping from Deep Image Segmentation

RGB-D Semantic Segmentation and Label-Oriented Voxelgrid Fusion for Accurate 3D Semantic Mapping

A Fully Convolutional Networks(FCN)-Based Image Segmentation Algorithm in Binocular Imaging System