Abstract:Many problems in computer vision involve assigning each pixel a label, which represents some spatially varying quantity such as image intensity in image denoising or object index label in image segmentation. In general, such quantities in image processing tend to be spatially piecewise smooth, since they vary smoothly in the object surface and change dramatically at object boundaries, while in video processing, additional temporal smoothness is satisfied as the corresponding pixels in different frames should have similar labels. Markov random field (MRF) models provide a robust and unified framework for many image and video applications. The framework can be elegantly expressed as an MRF-based energy minimization problem, where two penalty terms are defined with different forms. Many approaches have been proposed to solve the MRF-based energy optimization problem, such as simulated annealing, iterated conditional modes, graph cuts, and belief propagation. In this dissertation, we propose three methods to solve the problems of interactive image segmentation, video completion, and image denoising, which are all formulated as MRF-based energy minimization problems. In our algorithms, different MRF-based energy functions with particular techniques according to the characteristics of different tasks are designed to well fit the problems. With the energy functions, different optimization schemes are proposed to find the optimal results in these applications. In interactive image segmentation, an iterative optimization based framework is proposed, where in each iteration an MRF-based energy function incorporating an estimated initial probabilistic map of the image is optimized with a relaxed global optimal solution. In video completion, a well-defined MRF energy function involving both spatial and temporal coherence relationship is constructed based on the local motions calculated in the first step of the algorithm. A hierarchical belief propagation optimization scheme is proposed to efficiently solve the problem. In image denoising, label relaxation based optimization on a Gaussian MRF energy is used to achieve the global optimal closed form solution. Promising results obtained by the proposed algorithms, with both quantitative and qualitative comparisons to the state-of-the-art methods, demonstrate the effectiveness of our algorithms in these image and video processing applications.

A common framework for image segmentation

Automatic Segmentation of Objects of Interest from an Image

Image segmentation by MAP-ML estimations.

Image segmentation by data-driven markov chain monte carlo

Algorithm of Minimizing Local Region Energy for Image Segmentation

Intensity Inhomogeneity Image Segmentation Based On Active Contours Driven By Self-Similarity

Image Segmentation with Simultaneous Illumination and Reflectance Estimation: an Energy Minimization Approach

Region competition: unifying snakes, region growing, energy/Bayes/MDL for multi-band image segmentation

A hybrid framework for image segmentation using probabilistic integration of heterogeneous constraints

A Graphical Model Framework For Image Segmentation

A Nonlocal Energy Minimization Approach to Brain Image Segmentation with Simultaneous Bias Field Estimation and Denoising

Probabilistic Model of Visual Segmentation

Markov random fields based image and video processing

Effective Bayesian Inference by Data-Driven Markov Chain Monte Carlo for Object Recognition and Image Segmentation

Image segmentation by adaptive distance based on EM algorithm

Image Segmentation Based on Multi-Region Multi-Scale Local Binary Fitting and Kullback–Leibler Divergence

A Multiphase Level Set Formulation for Image Segmentation Using a MRF-based Nonsymmetric Student’s- T Mixture Model

Efficient Message Passing Methods With Fully Connected Models for Early Vision

A Markov Random Field Model for Image Segmentation Based on Gestalt Laws.

A framework for evaluating image segmentation algorithms

Active contour driven by region-scalable fitting and Kullback-Leibler divergence for image segmentation