Abstract:Efficient dense reconstruction of objects or scenes has substantial practical implications, which can be applied to different 3D tasks (for example, robotics and autonomous driving). However, because of the expensive hardware required and the overall complexity of the all-around scenarios, efficient dense reconstruction using lightweight multi-view stereo methods has received much attention from researchers. The technological challenge of efficient dense reconstruction is maintaining low memory usage while rapidly and reliably acquiring depth maps. Most of the current efficient multi-view stereo (MVS) methods perform poorly in efficient dense reconstruction, this poor performance is mainly due to weak generalization performance and unrefined object edges in the depth maps. To this end, we propose EMO-MVS, which aims to accomplish multi-view stereo tasks with high efficiency, which means low-memory consumption, high accuracy, and excellent generalization performance. In detail, we first propose an iterative variable optimizer to accurately estimate depth changes. Then, we design a multi-level absorption unit that expands the receptive field, which efficiently generates an initial depth map. In addition, we propose an error-aware enhancement module, enhancing the initial depth map by optimizing the projection error between multiple views. We have conducted extensive experiments on challenging datasets Tanks and Temples and DTU, and also performed a complete visualization comparison on the BlenedMVS validation set (which contains many aerial scene images), achieving promising performance on all datasets. Among the lightweight MVS methods with low-memory consumption and fast inference speed, our F-score on the online Tanks and Temples intermediate benchmark is the highest, which shows that we have the best competitiveness in terms of balancing the performance and computational cost.

Fast Best Viewpoint Selection with Geometry-Enhanced Multiple Views and Cross-Modal Distillation

Structure-aware Viewpoint Selection for Volume Visualization

Monocular Viewpoints Estimation for Generic Objects in the Wild

View Synthesis with Multi-scale Cost Aggregation and Confidence Prior

Distilling Sub-Space Structure Across Views for Cardiac Indices Estimation

Multi-View Stereo Representation Revist: Region-Aware MVSNet

Improving Viewpoint-Independent Object-Centric Representations through Active Viewpoint Selection

Perceptual-Based Automatic Viewpoint Selection

Vision Dependent Viewpoint Selection Method in 3D Scene Observation

View-based 3D object retrieval with discriminative views.

A classification-based approach for best view selection of 3D models

Retrieval-Specific View Learning for Sketch-to-Shape Retrieval

Optimized View and Geometry Distillation from Multi-view Diffuser

MV-DUSt3R+: Single-Stage Scene Reconstruction from Sparse Views In 2 Seconds

EMO-MVS: Error-Aware Multi-Scale Iterative Variable Optimizer for Efficient Multi-View Stereo

Learning to Select Camera Views: Efficient Multiview Understanding at Few Glances

View Selection of 3d Objects Based on Saliency Segmentation

ProbIBR: Fast Image-Based Rendering with Learned Probability-Guided Sampling

BEVDistill: Cross-Modal BEV Distillation for Multi-View 3D Object Detection

CrossView-GS: Cross-view Gaussian Splatting For Large-scale Scene Reconstruction

Deep Learning-Based Viewpoint Recommendation in Volume Visualization