Abstract:In this paper, we present a stochastic algorithm by effective Markov chain Monte Carlo (MCMC) for segmenting and reconstructing 3D scenes. The objective is to segment a range image and its associated reflectance map into a number of surfaces which fit to various 3D surface models and have homogeneous reflectance (material) properties. In comparison to previous work on range image segmentation, the paper makes the following contributions. Firstly, it is aimed at generic natural scenes, indoor and outdoor, which are often much complexer than most of the existing experiments in the "polyhedra world". Natural scenes require the algorithm to automatically deal with multiple types (families) of surface models which compete to explain the data. Secondly, it integrates the range image with the reflectance map. The latter provides material properties and is especially useful for surface of high specularity, such as glass, metal, ceramics. Thirdly, the algorithm is designed by reversible jump and diffusion Markov chain dynamics and thus achieves globally optimal solutions under the Bayesian statistical framework. Thus it realizes the cue integration and multiple model switching. Fourthly, it adopts two techniques to improve the speed of the Markov chain search: One is a coarse-to-fine strategy and the other are data driven techniques such as edge detection and clustering. The data driven methods provide important information for narrowing the search spaces in a probabilistic fashion. We apply the algorithm to two data sets and the experiments demonstrate robust and satisfactory results on both. Based on the segmentation results, we extend the reconstruction of surfaces behind occlusions to fill in the occluded parts.

3D Shape Segmentation Using Multiple Random Walkers.

An Improved Random Walker with Bayes Model for Volumetric Medical Image Segmentation.

Simultaneous Segmentation of Multiple Organs Using Random Walks

Rapid and effective segmentation of 3D models using random walks

3D Shapes Co-segmentation by Combining Fuzzy C-Means with Random Walks

A knowledge-based interactive liver segmentation using random walks

Fast mesh segmentation using random walks

Random Walks Colour Histogram Modification for Human Tracking.

Segmentation Algorithm of Moving Object Based on Mean Field Theory and MRF-MAP

CloudWalker: Random walks for 3D point cloud shape analysis

Segmentation Using SubMarkov Random Walk

A Novel Topic-Level Random Walk Framework For Scene Image Co-Segmentation

A Stochastic Algorithm for 3D Scene Segmentation and Reconstruction

Efficient Multigrid Solver for the 3D Random Walker Algorithm

User-controllable Mesh Segmentation Using Shape Harmonic Signature

A novel segmentation algorithm for complex 3D mesh model in computer vision.

Interesting moving object segmentation based on selective visual attention and Markov random field

Scribble-Based 3D Shape Segmentation via Weakly-Supervised Learning

Collaborative Propagation on Multiple Instance Graphs for 3D Instance Segmentation with Single-point Supervision

An Iterative Boundary Random Walks Algorithm for Interactive Image Segmentation

Keep the geometries: Image segmentation by K-MSVC with random region grouping and propagation