Abstract:In this paper, we present a stochastic algorithm by effective Markov chain Monte Carlo (MCMC) for segmenting and reconstructing 3D scenes. The objective is to segment a range image and its associated reflectance map into a number of surfaces which fit to various 3D surface models and have homogeneous reflectance (material) properties. In comparison to previous work on range image segmentation, the paper makes the following contributions. Firstly, it is aimed at generic natural scenes, indoor and outdoor, which are often much complexer than most of the existing experiments in the "polyhedra world". Natural scenes require the algorithm to automatically deal with multiple types (families) of surface models which compete to explain the data. Secondly, it integrates the range image with the reflectance map. The latter provides material properties and is especially useful for surface of high specularity, such as glass, metal, ceramics. Thirdly, the algorithm is designed by reversible jump and diffusion Markov chain dynamics and thus achieves globally optimal solutions under the Bayesian statistical framework. Thus it realizes the cue integration and multiple model switching. Fourthly, it adopts two techniques to improve the speed of the Markov chain search: One is a coarse-to-fine strategy and the other are data driven techniques such as edge detection and clustering. The data driven methods provide important information for narrowing the search spaces in a probabilistic fashion. We apply the algorithm to two data sets and the experiments demonstrate robust and satisfactory results on both. Based on the segmentation results, we extend the reconstruction of surfaces behind occlusions to fill in the occluded parts.

Multiresolution Model Construction from Scattered Range Data by Hierarchical Cube-Based Segmentation

Shape simplification of free-form surface objects for multi-scale representation

3D Reconstruction Based on Image Segmentation

A Multiscale-Contour-based Interpolation Framework for Generating a Time-Varying Quasi-Dense Point Cloud Sequence.

Re-Sampling Of 3-D Object Range Data By Cube-Based Segmentation

A novel segmentation algorithm for complex 3D mesh model in computer vision.

Distributed Refinement of Large-Scale 3D Mesh for Accurate Multi-View Reconstruction

DP-MVS: Detail Preserving Multi-View Surface Reconstruction of Large-Scale Scenes

A Divide-and-Conquer Approach to Quad Remeshing

Multi-Resolution Surface Description of 3-D Objects by Shape-Adaptive Triangular Meshes

Multiresolution Free Form Object Modeling with Point Sampled Geometry.

Multi-View Depth Map Sampling for 3D Reconstruction of Natural Scene

Modeling Based On Multi-Scale Quadtree Image

A Stochastic Algorithm for 3D Scene Segmentation and Reconstruction

An efficient framework for constructing multiresolution models from unorganized points

A New Algorithm for Multiresolution Isosurface Extraction.

View-dependent and Multi-Resolution Simplification Algorithm of a Terrain Model

On-the-fly Simplification of Large Iso-Surfaces with Per-Cube Vertex Modifiability Detection.

Superquadric-Based Object Modeling by an Iterative Segmentation-And-Recovery Algorithm

An Efficient Volumetric Mesh Representation for Real-time Scene Reconstruction using Spatial Hashing

Hierarchical Face Cluster Partitioning of Polygonal Surfaces and High-Speed Rendering