Abstract:This paper presents a unified variational formulation for joint object segmentation and stereo matching, which takes both accuracy and efficiency into account. In our approach, depth-map consists of compact objects, each object is represented through three different aspects: 1) the perimeter in image space; 2) the slanted object depth plane; and 3) the planar bias, which is to add an additional level of detail on top of each object plane in order to model depth variations within an object. Compared with traditional high quality solving methods in low level, we use a convex formulation of the multilabel Potts Model with PatchMatch stereo techniques to generate depth-map at each image in object level and show that accurate multiple view reconstruction can be achieved with our formulation by means of induced homography without discretization or staircasing artifacts. Our model is formulated as an energy minimization that is optimized via a fast primal-dual algorithm, which can handle several hundred object depth segments efficiently. Performance evaluations in the Middlebury benchmark data sets show that our method outperforms the traditional integer-valued disparity strategy as well as the original PatchMatch algorithm and its variants in subpixel accurate disparity estimation. The proposed algorithm is also evaluated and shown to produce consistently good results for various real-world data sets (KITTI benchmark data sets and multiview benchmark data sets).

Stereoscopic Video Object Segmentation Based on Disparity Map

Object segmentation based on disparity estimation

Object segmentation using stereo images

Object segmentation based on accurate disparity estimation

Space-temporal stereo matching for dynamic scene

A Stereo Video Object Segmentation Algorithm Based on Motion Detection and Disparity

Segment-based Continuous Stereo Matching

New Real-Time Algorithm for Multiview Disparity-Based 3D-Object Segmentation.

StereoPasting: interactive composition in stereoscopic images.

An Efficient Stereo Disparity Estimation Method Based on Region Information

SegStereo: Exploiting Semantic Information for Disparity Estimation

Segmentation-based dense stereo matching algorithm for virtual view synthesis

Depth Extraction Method Based on Multi-view Stereo Matching

Spatio-Temporal Video Segmentation of Static Scenes and Its Applications

Depth Segmentation in Real-World Scenes Based on U-V Disparity Analysis

Human Segmentation Based on Disparity Map and GrabCut

A multiview video quality assessment method based on disparity and SSIM

PM-PM: PatchMatch with Potts Model for Object Segmentation and Stereo Matching.

Segment-Based Disparity Refinement With Occlusion Handling for Stereo Matching

Spatio-Temporal Segmentation with Depth-Inferred Videos of Static Scenes

Stereo Matching with Space-Constrained Cost Aggregation and Segmentation-Based Disparity Refinement