A multi-view video coding scheme for interactive streaming with low decoding cost

Jian Xie,Lifeng Sun,Xiaoyu Cheng,Yuzhuo Zhong

2006-01-01

Abstract:In this paper, a new multi-view coding scheme for interactive streaming with low decoding cost is proposed. We focus on three requirements of multi-view video coding: 1) compression efficiency; 2) cost of single view decoding; 3) fast view switching. In the scheme proposed, all views are divided into view groups before encoding. Then, a prediction structure for each view group encoding is designed. To achieve higher compression efficiency, the temporal middle frames of each GOP are selected as the key frames, which are encoded using inter-view prediction across different views. To achieve better streaming efficiency, spatial prediction between non-key frames is not used. Furthermore, a view switching method at non-switch points using inter-view reference frames is introduced to improve the interactivity. H.264/AVC coding scheme is employed as the platform. Experimental results show that, compared with simulcast and GoGOP coding method, our proposed scheme achieve 1-2 dB in average gain in compression efficiency or in cost of single view decoding under the same limitation of view switching delay. We also get acceptable non-switch points switching quality, which has significant gain compared with direct switching.