Abstract:Multi-view video, which simultaneously acquires multiple video sequences from multiple viewpoints or view directions, is poised to become the next generation video technology. Exploiting redundancy is the hallmark of traditional video coding but is even more essential in multi-view video coding (MVC) where the data size is extremely large. The exploitation of additional redundancies, however, incurs extra computational overhead, thereby counteracting the benefits gained from coding efficiency. This dissertation proposes an efficient MVC scheme that provides a complete encoding solution with low complexity. This includes exploitation of inter- and intra-view redundancies for achieving high coding efficiency, and exploitation of inter-view and temporal domain coded information for lowering the coding complexity. In order to be compatible with single-view applications, a multi-view scene typically consists of at least one base view (BV) and multiple enhancement views (EVs). The proposed encoding scheme first segments the pre-encoded BV into objects and background using a proposed fast segmentation technique with low overhead. Next, it generates the initial disparity maps (DM) of each object and background as well as initial inter-view prediction frame for each EV using an object registration and warping algorithm. With this initial DM, fast EV coding can be realized by using the coded information in BV. This approach has several advantages: First, the DMs for EVs are refined based on the initial DM within small search range. Second, disparity vectors (DVs) are differentially encoded with respect to the initial DV, which leads to bit-rate savings and reduced computational complexity. Third, in addition to block-based disparity compensated prediction, one more inter-view prediction is provided, which enhances accuracy with low encoding overhead. Fourth, guided by the initial DM, the motion vectors (MVs) of the EV are predicted from the MV field of the BV, which leads to lower complexity motion estimation. Another contribution of this work is an efficient frame-based segmentation algorithm for MVC. The algorithm combines the intensity of the reconstructed frame and MVs obtained from the pre-encoded base view in MVC to segment objects in fast turnaround time. The proposed segmentation, object warping and registration methodologies, collectively provide a complete compression scheme.

Multi-view Video Coding Based on View Prediction

Multi-View Video Coding Based on Vector Estimation and Weighted Disparity Interpolation

A Network-Friendly Architecture for Multi-View Video Coding (Mvc)

Multi-view Video Coding Based on Resultant Vector Estimation

A New Inter-View Prediction Method for Multi-View Video Coding

Multi-view video coding based on sequence correlation

View-Adaptive Motion Estimation and Disparity Estimation for Low Complexity Multiview Video Coding

Inter-view Prediction Method Based on Camera Geometry

Multi-view video coding with flexible view-temporal prediction structure for fast random access

Fast Inter-Frame Prediction in Multi-View Video Coding Based on Perceptual Distortion Threshold Model

Selective Disparity Estimation and Variable Size Motion Estimation Based on Motion Homogeneity for Multi-View Coding

Efficient Multi-View Video Coding Scheme Based on Dynamic Video Object Segmentation

Motion Vector Prediction in Multiview Video Coding

Iterative Search Strategy with Selective Bi-Directional Prediction for Low Complexity Multiview Video Coding

An Improved Multi-view Video Coding Prediction Structure

Macroblock-Level Adaptive Search Range Algorithm for Motion Estimation in Multiview Video Coding

Multi-view video coding based on multi-dimensional vector matrix

Color Compensation for Multi-View Video Coding Based on Diversity of Cameras

Fast Mode Decision for Multiview Video Coding Based on Just Noticeable Distortion Profile

Optimizing Inter-View Prediction Structures for Multi-View Video Coding Using Simulated Annealing

Rendering-oriented Multiview Video Coding Based on Chrominance Information Reconstruction