Abstract:Many problems in computer vision involve assigning each pixel a label, which represents some spatially varying quantity such as image intensity in image denoising or object index label in image segmentation. In general, such quantities in image processing tend to be spatially piecewise smooth, since they vary smoothly in the object surface and change dramatically at object boundaries, while in video processing, additional temporal smoothness is satisfied as the corresponding pixels in different frames should have similar labels. Markov random field (MRF) models provide a robust and unified framework for many image and video applications. The framework can be elegantly expressed as an MRF-based energy minimization problem, where two penalty terms are defined with different forms. Many approaches have been proposed to solve the MRF-based energy optimization problem, such as simulated annealing, iterated conditional modes, graph cuts, and belief propagation. In this dissertation, we propose three methods to solve the problems of interactive image segmentation, video completion, and image denoising, which are all formulated as MRF-based energy minimization problems. In our algorithms, different MRF-based energy functions with particular techniques according to the characteristics of different tasks are designed to well fit the problems. With the energy functions, different optimization schemes are proposed to find the optimal results in these applications. In interactive image segmentation, an iterative optimization based framework is proposed, where in each iteration an MRF-based energy function incorporating an estimated initial probabilistic map of the image is optimized with a relaxed global optimal solution. In video completion, a well-defined MRF energy function involving both spatial and temporal coherence relationship is constructed based on the local motions calculated in the first step of the algorithm. A hierarchical belief propagation optimization scheme is proposed to efficiently solve the problem. In image denoising, label relaxation based optimization on a Gaussian MRF energy is used to achieve the global optimal closed form solution. Promising results obtained by the proposed algorithms, with both quantitative and qualitative comparisons to the state-of-the-art methods, demonstrate the effectiveness of our algorithms in these image and video processing applications.

Continuous MRF Based Image Denoising with a Closed Form Solution.

Edge preserving image denoising with a closed form solution

Frequency-Relevant Residual Learning for Multi-Modal Image Denoising.

MRF and CRF Based Image Denoising and Segmentation

Image Denoising with Wavelet Markov Fields of Experts

Image denoising based on hierarchical Markov random field

Image segmentation by MAP-ML estimations.

Markov random fields based image and video processing

An Efficient Gaussian Filter Based on Gaussian Symmetric Markov Random Field

Study of a Robust MRF-MAP Image Segmentation Framework

A Region Markov Random Field Model with Integrated Edge Feature and Image Segmentation Algorithm

A Novel MRF-Based Image Segmentation Algorithm

A novel image denoising algorithm using linear Bayesian MAP estimation based on sparse representation

An Efficient Markov Random Field Based Denoising Approach for Dynamic Vision Sensor

Deep Gaussian Conditional Random Field Network: A Model-based Deep Network for Discriminative Denoising

MCMC algorithm based on Markov random field in image segmentation

Non-monotone Boosted DC and Caputo Fractional Tailored Finite Point Algorithm for Rician Denoising and Deblurring

NegCut: Automatic Image Segmentation Based on MRF-MAP

RHFMs Similarity Based Nonlocal Means Image Denoising in PDTDFB Domain

An Image Denoising Algorithm for Mixed Noise Combining Nonlocal Means Filter and Sparse Representation Technique

A Markov Random Field Integrating Spectral Dissimilarity and Class Co-Occurrence Dependency for Remote Sensing Image Classification Optimization