Abstract:Multiview stereo (MVS) aims to measure the precise surface depth of a scene from observations at multiple photography angles and then densely reconstruct its 3-D geometry information. Learning-based MVS approaches have been dominantly popular for their robustness to low texture areas and non-Lambertian surfaces. However, most existing methods focus on estimating depth maps for input images by constructing global cost volumes and designing ingenious yet large variance-based 3-D-CNNs for cost volume regularization. Such approaches ignore the co-visible relationship embedded in multiple views, resulting in heavy computation, erroneous cost aggregation from invisible views, and finally inaccurate 3-D reconstruction results. In this article, we propose a co-visibility reasoning MVS network (CR-MVSNet) to explore the co-visible relationships hidden in multiple views for reliable multiview similarity measurement and efficient reconstruction. Precisely, the proposed co-visibility reasoning cost aggregation (CRCA) module includes the adaptive intercost volume aggregation via mining the uncertainty of co-visibility relationships in multiple views and the adaptive intracost volume aggregation by exploiting spatial contextual information. Moreover, the cost volumes are constructed via the proposed global-to-patch manner to speed up computation. Experimental results show that our approach achieves the best overall performance on the DTU, Tanks and Temples, and ETH3D-test datasets over recent state-of-the-art MVS algorithms. The consistently favorable results on three datasets with completely different depth ranges proved the superiority and generalizability of CR-MVSNet.

Learning Visible Surface Area Estimation for Irregular Objects

Recognition and Distance Estimation of an Irregular Object in Package Sorting Line Based on Monocular Vision

Semi-Supervised Learning for Visual Bird's Eye View Semantic Segmentation

Irregular Object Measurement Method Based on Improved Adaptive Slicing Method

A Novel Recurrent Encoder-Decoder Structure for Large-Scale Multi-View Stereo Reconstruction From an Open Aerial Dataset

Semantic surrounding projection for object height estimation using single-line lidar and image

Spherical Transformer for LiDAR-based 3D Recognition

Learning Occupancy for Monocular 3D Object Detection

Incorporating Co-Visibility Reasoning into Surface Depth Measurement

Large-Scale 3D Semantic Mapping Using Monocular Vision

Detection and Segmentation of Unlearned Objects in Unknown Environment

VAIR: Visuo-Acoustic Implicit Representations for Low-Cost, Multi-Modal Transparent Surface Reconstruction in Indoor Scenes

VSRD: Instance-Aware Volumetric Silhouette Rendering for Weakly Supervised 3D Object Detection

Training an Open-Vocabulary Monocular 3D Object Detection Model without 3D Data

Open-Vocabulary Category-Level Object Pose and Size Estimation

Visual-Inertial Object Detection and Mapping

Training and Testing Object Detectors with Virtual Images

3D Object Detection and Pose Estimation of Unseen Objects in Color Images with Local Surface Embeddings

OccuSeg: Occupancy-Aware 3D Instance Segmentation

3D reconstruction and volume measurement of irregular objects based on RGB-D camera