Abstract:This paper reviews multi‐view stereo (MVS) algorithms for the generation of dense 3D point clouds from a set of images. Despite the widespread evolution of the algorithms and vast amount of research, the creation of complete, accurate and aesthetically pleasing 3D representations of a scene remains an open issue in real‐world and large‐scale photogrammetric applications. We provide a complete survey on the most widely used MVS methods, investigating underlying concepts and challenges for both conventional and learning‐based approaches, with a particular focus on close‐range 3D reconstruction applications. 3D reconstruction of scenes using multiple images, relying on robust correspondence search and depth estimation, has been thoroughly studied for the two‐view and multi‐view scenarios in recent years. Multi‐view stereo (MVS) algorithms aim to generate a rich, dense 3D model of the scene in the form of a dense point cloud or a triangulated mesh. In a typical MVS pipeline, the robust estimations for the camera poses along with the sparse points obtained from structure from motion (SfM) are used as input. During this process, the depth of generally every pixel of the scene is to be calculated. Several methods, either conventional or, more recently, learning‐based have been developed for solving the correspondence search problem. A vast amount of research exists in the literature using local, global or semi‐global stereomatching approaches, with the PatchMatch algorithm being among the most popular and efficient conventional ones in the last decade. Yet, and despite the widespread evolution of the algorithms, yielding complete, accurate and aesthetically pleasing 3D representations of a scene remains an open issue in real‐world and large‐scale photogrammetric applications. This work aims to provide a concrete survey on the most widely used MVS methods, investigating underlying concepts and challenges. To this end, the theoretical background and relative literature are discussed for both conventional and learning‐based approaches, with a particular focus on close‐range 3D reconstruction applications.

A Survey of Geometric Vision

An Invitation to 3-D Vision: From Images to Geometric Models

Fundamentals of Machine Vision

On Symmetry and Multiple-View Geometry: Structure, Pose, and Calibration from a Single Image

Cameras Viewing Cameras Geometry

Multiple-view geometry for image-based modeling.

A Lie Theoretic Approach to Structure and Motion in Computer Vision 1

Computer Vision Overview

Some Aspects of Geometric Computer Vision for Analysing Dynamical Scenes focusing Automotive Applications

Geometric Principles of Multiple Visual Sensors

Structure and Pose from Single Images of Symmetric Objects with Applications to Robot Navigation

Snapshot of Algebraic Vision

Symmetry-based 3-D Reconstruction from Perspective Images

3D Scene Geometry Estimation from 360$^\circ$ Imagery: A Survey

Problems and related results in Algebraic Vision and Multiview Geometry

Geometric Constraints in Deep Learning Frameworks: A Survey

3D Reconstruction through Fusion of Cross-View Images

A Geometric Approach to Obtain a Bird's Eye View from an Image

3D Reconstruction From Traditional Methods to Deep Learning

A Comprehensive Review of Vision-Based 3D Reconstruction Methods

A survey on conventional and learning‐based methods for multi‐view stereo