Abstract:In this paper we present a method of using standard multi-view images for 3D surface reconstruction of non-Lambertian objects. We extend the original visual hull concept to incorporate 3D cues presented by internal occluding contours, i.e., occluding contours that are inside the object's silhouettes. We discovered that these internal contours, which are results of convex parts on an object's surface, can lead to a tighter fit than the original visual hull. We formulated a new visual hull refinement scheme - Locally Convex Carving that can completely reconstruct concavity caused by two or more intersecting convex surfaces.In addition we develop a novel approach for contour tracking given labeled contours in sparse key frames. It is designed specifically for highly specular or transparent objects, for which assumptions made in traditional contour detection/tracking methods, such as highest gradient and stationary texture edges, are no longer valid. It is formulated as an energy minimization function where several novel terms are developed to increase robustness.Based on the two core algorithms, we have developed an interactive system for 3D modeling. We have validated our system, both quantitatively and qualitatively, with four datasets of different object materials. Results show that we are able to generate visually pleasing models for very challenging cases.

Accelerated Visual Hulls of Complex Objects Using Contribution Weights

Convex hull properties and algorithms

An Algorithm to Generate Visual Hulls

A novel approach for computing exact visual hull from silhouettes

Interactive Visual Hull Refinement For Specular And Transparent Object Surface Reconstruction

Prototype Modeling from Sketched Silhouettes Based on Convolution Surfaces.

Visual Hull Embossment By Graph Cuts

Visual Hull Computation Based on Level Set Method.

A robust and accurate method for visual hull computation

A Fast Algorithm for Topologically Generating Visual Hull

Simulation platform for computing visual hull of 3D objects

Bottom and Concave Surface Rendering in Image-Based Visual Hull.

Deformable Model Based Visual Hull Computation from Multi-images

A Fast Convex Hull Algorithm Inspired by Human Visual Perception

Algorithms for Local Concave Surface Recovery from Visual Hull Models

GPU-Accelerated Visual Hull Rendering

Efficient Collision Determination for Dynamic Scenes using Coherent Separating Axis

A parallel and optimized volumetric visual hull reconstruction method

A 3D reconstruction algorithm of multiple objects

Optimized Volumetric Visual Hull Reconstruction Method Based on CUDA

Reconstruction of Shape and Reflectance Properties Based on Visual Hull