Graph signal processing for compression and restoration of piecewise smooth images

Wei Hu
DOI: https://doi.org/10.14711/thesis-b1514564
2015-01-01
Abstract:The objective of this research is to develop graph signal processing techniques to address challenges in compression and restoration of piecewise smooth (PWS) images, which have wide applications to 3D video coding, depth-image-based rendering, image segmentation, etc. While generic image processing tools are applicable to these problems, PWS images (e.g., depth maps or animation images) possess unique signal characteristics, such as sharp object boundaries and slowly-varying interior surfaces, which we exploit for better performance. Specifically, leveraging on recent advances in graph signal processing, we essentially propose compact representations of PWS images in the graph transform domain or in the graph spatial domain. The effective representations of PWS images contribute to improved compression and restoration performance. In the transform domain, Graph Fourier Transform (GFT) representation provides approximately optimal energy compaction of PWS images when the graph is appropriately constructed, which is useful for compact compression. We first propose a multi-resolution GFT scheme for compression of PWS images. In particular, we propose an optimality criterion of the GFT, which minimizes the total signal representation cost of each pixel block, considering both the sparsity of the signal's transform coefficients and the compactness of transform description. Efficient algorithms are developed to search for optimal GFTs, leveraging on graph optimization techniques. Further, we introduce two techniques to reduce computation complexity of the GFT. Experimental results show that we outperform a …
What problem does this paper attempt to address?