Abstract:Multi-View Stereo (MVS) is a fundamental problem in geometric computer vision which aims to reconstruct a scene using multi-view images with known camera parameters. However, the mainstream approaches represent the scene with a fixed all-pixel depth range and equal depth interval partition, which will result in inadequate utilization of depth planes and imprecise depth estimation. In this paper, we present a novel multi-stage coarse-to-fine framework to achieve adaptive all-pixel depth range and depth interval. We predict a coarse depth map in the first stage, then an Adaptive Depth Range Prediction module is proposed in the second stage to zoom in the scene by leveraging the reference image and the obtained depth map in the first stage and predict a more accurate all-pixel depth range for the following stages. In the third and fourth stages, we propose an Adaptive Depth Interval Adjustment module to achieve adaptive variable interval partition for pixel-wise depth range. The depth interval distribution in this module is normalized by Z-score, which can allocate dense depth hypothesis planes around the potential ground truth depth value and vice versa to achieve more accurate depth estimation. Extensive experiments on four widely used benchmark datasets (DTU, TnT, BlendedMVS, ETH 3D) demonstrate that our model achieves state-of-the-art performance and yields competitive generalization ability. Particularly, our method achieves the highest Acc and Overall on the DTU dataset, while attaining the highest Recall and F1 -score on the Tanks and Temples intermediate and advanced dataset. Moreover, our method also achieves the lowest e1 and e3 on the BlendedMVS dataset and the highest Acc and F1 -score on the ETH 3D dataset, surpassing all listed methods. Project website: https://github.com/zs670980918/ARAI-MVSNet

Blendedmvs: A Large-Scale Dataset For Generalized Multi-View Stereo Networks

Benchmarking Large-Scale Multi-View 3D Reconstruction Using Realistic Synthetic Images

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

Confidence-Based Large-Scale Dense Multi-View Stereo

LoliMVS: An End-to-End Network for Multiview Stereo With Low-Light Images

HC-MVSNet: A Probability Sampling-Based Multi-View-stereo Network with Hybrid Cascade Structure for 3D Reconstruction

MVImgNet2.0: A Larger-scale Dataset of Multi-view Images

Multi-View Stereo Representation Revist: Region-Aware MVSNet

Attention Aware Cost Volume Pyramid Based Multi-view Stereo Network for 3D Reconstruction

DP-MVS: Detail Preserving Multi-View Surface Reconstruction of Large-Scale Scenes

Rethinking the Multi-view Stereo from the Perspective of Rendering-based Augmentation

MVSNet: Depth Inference for Unstructured Multi-view Stereo

Mono‐MVS: textureless‐aware multi‐view stereo assisted by monocular prediction

High completeness multi-view stereo for dense reconstruction of large-scale urban scenes

A Novel Recurrent Encoder-Decoder Structure for Large-Scale Multi-View Stereo Reconstruction From an Open Aerial Dataset

MTD-MVSNet: Multi-view Stereo Network with Multi-scale Transformer and Dual Attention

ARAI-MVSNet: A multi-view stereo depth estimation network with adaptive depth range and depth interval

Vis-MVSNet: Visibility-Aware Multi-view Stereo Network

Bi-ClueMVSNet: Learning Bidirectional Occlusion Clues for Multi-View Stereo.

SA-MVSNet: Self-attention-based multi-view stereo network for 3D reconstruction of images with weak texture

GC-MVSNet: Multi-View, Multi-Scale, Geometrically-Consistent Multi-View Stereo