Abstract:This paper reviews multi‐view stereo (MVS) algorithms for the generation of dense 3D point clouds from a set of images. Despite the widespread evolution of the algorithms and vast amount of research, the creation of complete, accurate and aesthetically pleasing 3D representations of a scene remains an open issue in real‐world and large‐scale photogrammetric applications. We provide a complete survey on the most widely used MVS methods, investigating underlying concepts and challenges for both conventional and learning‐based approaches, with a particular focus on close‐range 3D reconstruction applications. 3D reconstruction of scenes using multiple images, relying on robust correspondence search and depth estimation, has been thoroughly studied for the two‐view and multi‐view scenarios in recent years. Multi‐view stereo (MVS) algorithms aim to generate a rich, dense 3D model of the scene in the form of a dense point cloud or a triangulated mesh. In a typical MVS pipeline, the robust estimations for the camera poses along with the sparse points obtained from structure from motion (SfM) are used as input. During this process, the depth of generally every pixel of the scene is to be calculated. Several methods, either conventional or, more recently, learning‐based have been developed for solving the correspondence search problem. A vast amount of research exists in the literature using local, global or semi‐global stereomatching approaches, with the PatchMatch algorithm being among the most popular and efficient conventional ones in the last decade. Yet, and despite the widespread evolution of the algorithms, yielding complete, accurate and aesthetically pleasing 3D representations of a scene remains an open issue in real‐world and large‐scale photogrammetric applications. This work aims to provide a concrete survey on the most widely used MVS methods, investigating underlying concepts and challenges. To this end, the theoretical background and relative literature are discussed for both conventional and learning‐based approaches, with a particular focus on close‐range 3D reconstruction applications.

NRMVS: Non-Rigid Multi-View Stereo

Multi-view 3D Reconstruction from Uncalibrated Radially-Symmetric Cameras

Hybrid-MVS: Robust Multi-View Reconstruction with Hybrid Optimization of Visual and Depth Cues

CNLPA-MVS: Coarse-Hypotheses Guided Non-Local PatchMatch Multi-View Stereo

Multi-View Stereo Representation Revist: Region-Aware MVSNet

N2MVSNet: Non-Local Neighbors Aware Multi-View Stereo Network

Monocular 3D Reconstruction of Multiple Non-Rigid Objects by Union of Non-linear Spatial-Temporal Subspaces.

RC-MVSNet: Unsupervised Multi-View Stereo with Neural Rendering

NR-MVSNet: Learning Multi-View Stereo Based on Normal Consistency and Depth Refinement

A survey on conventional and learning‐based methods for multi‐view stereo

Multi-View Stereo with Asymmetric Checkerboard Propagation and Multi-Hypothesis Joint View Selection.

Confidence-Based Large-Scale Dense Multi-View Stereo

Multi-View 3D Reconstruction with Self-Organizing Maps on Event-Based Data

SD-MVS: Segmentation-Driven Deformation Multi-View Stereo with Spherical Refinement and EM optimization

Dense Multiview Stereo Based On Image Texture Enhancement

Real-Time Dense Construction with Deep Multiview Stereo Using Camera and IMU Sensors

MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds

Mesh-Guided Multi-View Stereo with Pyramid Architecture

GC-MVSNet: Multi-View, Multi-Scale, Geometrically-Consistent Multi-View Stereo

RNb-NeuS: Reflectance and Normal-based Multi-View 3D Reconstruction