Real-time Transmission of H.264/AVC Video Based on IP

Hongjuan Wang,Xiaoyan Shi,Zhaoyang Zhang,Wenjun Zhang

2005-01-01

Abstract:With the increasingly extensive application for the new emerging video coding standard,H.264/AVC,it becomes more and more important that we transport H.264/AVC video stream over IP Network real time.We propose a solution for it and focus on two respects—H.264-FGS encoder and rate control—to explain.

What problem does this paper attempt to address?

Key Technology Research And Analysis Of H.264/Avc Suitable For Wireless Network

Yun-Peng Liu,San-Yuan Zhang,Shu-Chang Xu,Yin Zhang

2009-01-01

Abstract:The emergence of H.264/AVC video compression standard provides better support functions for wireless network. The characteristics of limited bandwidth, high error rate of wireless channel and the constraints of computing and storage capacity of most mobile devices make the key technology of video codec in error resilience strategies, rate control, mode decision and scalable extension more important. In this paper, we first analyze the main and popular strategies in the key technology, and then we propose a method to choose and combine these strategies to validate the results and performance by experiment. Experiment shows the rational use of these technologies improves the quality of video transmission and provides reference for the video service evaluation.
Delay Constrained Self Congestion Control for FGS Video Streams

Wei Xing,Gang Sun,Dongming Lu,Mingguang Wu

DOI: https://doi.org/10.1109/ROBIO.2006.340377

2006-01-01

Abstract:Real-time video streaming over the Internet often suffers from a kind of congestion on the bottleneck links caused by the video stream itself, a phenomenon so called self congestion. The motion compensation based video coding algorithms make video streams of variable bit-rate nature, which cause burst traffic, extra transmission delay, and even queue overflow of the bottleneck link and video data loss at the receiver thereafter. This makes self-congestion control a necessity for streaming video. In this paper, a sender-side optimized congestion control scheme for MPEG-4 fine granularity scalable (FGS) coding video stream is proposed. The scheme not only attempts to minimize the received video distortion at the receiver side, but also tries to maintain a smooth transmission rate in the network. The simulation results show the effectiveness of the proposed scheme in terms of the received video quality, the smoothness of video transmission rate, and the variance of the size of the bottleneck queue.
Research on H.264/SVC Compressed Video Communication in 3G

Yunpeng Liu,Sanyuan Zhang,Shuchang Xu,Yin Zhang

DOI: https://doi.org/10.1109/iccse.2009.5228433

2009-01-01

Abstract:The emerging of third generation mobile system (3G) makes various video applications in wireless environment possible. Scalable video codec (SVC) is the latest amendment for H.264/AVC that allows efficient, standard-based temporal, spatial, and quality scalability of video bit streams. The 3rd Generation Partnership Project (3GPP) video services, e.g. multimedia broadcast/multicast services (MBMS), packet-switched streaming service (PSS) etc., may greatly benefit from the adoption of SVC. And 3GPP has been gradually discussing to select SVC as one of the video codec tools in 3G. But not every key technology of SVC can be implemented because of 3G wireless network's characteristic of time variation, high bit error rate, limited bandwidth, and 3G mobile terminal's limitation. So we analyze the key technology that adapts to 3G in this paper, and present compressed SVC video transmission in 3G wireless network together with the offline video transmission simulation in 3G wireless network. Here we modify the VCEG offline 3G transmission simulation model to transmit SVC byte stream format, moreover test and show the effect of SVC error resilient tools by using the model.
Study on significant technology of H.264 in mobile network

Yun-Peng Liu,San-Yuan Zhang,Shu-Chang Xu,Yin Zhang

2009-01-01

WSEAS TRANSACTIONS ON COMMUNICATIONS

Abstract:The characteristics of the mobile wireless network are limited bandwidth and high error rate, at same time the computing and storage capacity of the mobile devices are limited too. In order to ensure effective video compression and transmission, H.264/AVC standard provides the significant technologies and strategies in error resilience strategies, rate control, mode decision and scalable extension. On the basis of the detailed study in the strategies, a combination method is proposed, and experiment proves the quality of video transmission is improved at the same time the rate is reduced.
Extended application of scalable video coding methods

Zhi-gang Li,Zhao-yang Zhang,Biao Wu,Ying Zhang

DOI: https://doi.org/10.1007/11559573_45

2005-01-01

Abstract:SP(Synchronization-Predictive) frame coding, which enables high efficiency of switching between two video bitstreams with different qualities, is supported by H.264/AVC. And FGS(Fine-Granular-Scalability) coding is supported by MPEG-4 video standard. This paper proposes a solution for combination these two tools with each other so as to adapt to high bandwidth variations of Internet or wireless networks and to low bandwidth variations flexibly for transmitted video streams. Experimental results show that our proposed system outperforms FGS coding by 0.47dB and the H.264/AVC-based video stream switching approach by 0.23dB on average.
Adaptive network bandwidth control method for H.264 video stream transmission

刘高平,宋执环

DOI: https://doi.org/10.3785/j.issn.1008-973X.2012.12.003

2012-01-01

Abstract:A real-time video transmission control method using double buffers and double operation threads based on transmission control protocol (TCP) is proposed according to the characteristics of H.264 video stream encoding and real-time video stream transmission. Considering the video bit rate adjustment can not be same completely with network bandwidth variation in actual fact, three key control strategies, which are video frames discarding, video bitrate increase and decrease, were elaborated. In these control strategies, a frame address array is set up to achieve video data transmission and discarding according to the frame unit in the control method in order to avoid the emergence of "broken frame". At the same time, a linear weighted summation method is used to judge the change trend of the accumulated video data in the control method in order to ensure the correctness of the video bitrate adjustment. The specific procedures, test cases and comparison with exiting traditional methods were given at last. The test result and the comparison show that the proposed control method can ensure the video bitrate adaptive adjustment according to the network bandwidth fluctuation or video scene change under variable bit control, utilize network variable bandwidth in the greatest extent for transmitting video to receiver by real-time and play back smoothly in receiver accordingly, and can be applied effectively to real-time video surveillance under the circumstances of variable bandwidth network.
Transmission of Scalable Video over Networks

XL Shi,ZY Zhang

DOI: https://doi.org/10.1117/12.538985

2003-01-01

Abstract:In this paper, we proposed a new object-based coding algorithm by using wavelet transform to instead of the image encoder algorithm by using FGS in MPEG-4. The new object-based coding algorithm combines motion estimation with object-based 3-D wavelet transform for video coding in order to fully utilize the redundancy in the time domain. The shape-adaptive algorithm based on modifying boundary extension method of lifting scheme. A sequence of VOPs are fed into the motion compensated lifting (MCLIFT) wavelet coder which first decomposes the VOPs temporarily through MCLIFT filter, and then decomposes the VOPs spatially by shape adaptive lifting wavelet transform(SA-TWT). We encode the video and represent the stream as multilayer bit stream. The integrated transport-decoder buffer ensure the video be continuously transmitted. Losing package can be recovered by using re-transmission.
Transporting Real-Time Video over the Internet: Challenges and Approaches

Dapeng Wu,Yiwei Thoms Hou,Ya-Qin Zhang

DOI: https://doi.org/10.1109/5.899055

2000-01-01

Abstract:Delivering real-time video over the Internet is an important component of many Internet multimedia applications. Transmission of real-time video has bandwidth, delay, and loss requirements. However the current Internet does not offer any quality of service (QoS) guarantees to video transmission over the Internet. In addition, the heterogeneity of the networks and end systems makes it difficult to multicast Internet video in an efficient and flexible way. Thus, designing protocols and mechanisms for Internet video transmission poses many challenges. In this paper, we take a holistic approach to these challenges and present solutions from both transport and compression perspectives. With the holistic approach, we design a framework for transporting real-time Internet video, which includes two components, namely, congestion control and error control. Specifically congestion control consists of rate control, rate-adaptive encoding, and rate shaping; error control consists of forward error correction (FEC), retransmission error resilience, and error concealment. For the design of each component in the framework, we classify approaches and summarize representative research work. We point out there exists a design space which can be explored by video application designers and suggest that the synergy of both transport and compression could provide good solutions.
Scalable Video Coding and Transport over Broad-Band Wireless Networks

DP Wu,YWT Hou,YQ Zhang

DOI: https://doi.org/10.1109/5.904503

IF: 20.6

2001-01-01

Proceedings of the IEEE

Abstract:There has been great interest in transporting real-time video over wireless IP networks from both industry and academia. Real-time video applications have quality-of-service (QoS) requirements. However, the fluctuations of wireless channel conditions pose many challenges to providing QoS for video transmission over wireless IP networks. It has been shown that scalable video coding and adaptive services are viable solutions under a time-varying wireless environment. We propose an adaptive framework to support quality video communication over wireless IP networks. The adaptive framework includes: (1) scalable video representations, (2) network-aware video applications, and (3) adaptive services. Under this framework, as wireless channel conditions change, the mobile terminal and network elements can scale the video streams and transport the scaled video streams to receivers with acceptable perceptual quality. The key advantages of the adaptive framework are: (1) perceptual quality is degraded gracefully under severe channel conditions; (2) network resources are efficiently utilized; and (3) the resources are shared in a fair manner
Adaptive Efficient Video Transmission over the Internet Based on Congestion Control and Rs Coding

Huang Weihong,Zhang Fuyan,Sun Zhengxing

DOI: https://doi.org/10.1360/02yf9010

2002-01-01

Science in China Series F Information Sciences

Abstract:An approach based on adaptive congestion control and adaptive error recovery with RS (Reed-Solomon) coding method is presented for efficient video transmission over the Internet. Featured by weighted moving average rate control and TCP-friendliness, AVSP, a novel adaptive video streaming protocol, is designed with adjustable rate control parameters so as to respond quickly to the QoS status fluctuation during video transmission over the Internet. Combined with congestion control policy, an adaptive RS coding error recovery scheme with variable parameters is presented to enhance the robustness of MPEG video transmission over the Internet with restriction to the total system bandwidth.
A New FEC Scheme for Real-time Transmission of High Definition Video over IP Network

Qingguo Zhao,Chongrong Li,Xuan Zhang,Dongtao Liu

DOI: https://doi.org/10.1109/ipc.2007.50

2007-01-01

Abstract:Delivering high definition video (HDV) is a typical application on the next generation Internet (NGI). This paper pays attention to the packet loss during real-time delivering of HDV, aiming to seek an effective FEC scheme, which causes negligible additional delay and can meet different users' requirement of quality of service (QoS). Based on the character analysis of HDV, we propose a new FEC scheme based on Tornado Codes, with some special design to reduce the extra calculation load and provide QoS choice to users. Many experiments are conducted to evaluate the performance of our scheme. Experimental results show that, our scheme can effectively protect real-time HDV data, and users can custom the QoS level in a reasonable range.
Video Transmission over Cognitive Radio Networks

Jingfang Huang,Zhaoyang Zhang,Honggang Wang,Hong Liu

DOI: https://doi.org/10.1109/glocomw.2011.6162543

2011-01-01

Abstract:Distributed Video Coding (DVC) techniques utilize source statistics and dependencies among video frames in either spatial or time domain to compress the video and improve the error resilience. DVC promises great potentials for wireless video applications due to its advantages of using simple encoders. However, transmitting large size video stream consumes much network resource and still remains a challenging problem in terms of the resource efficiency. Recently, Cognitive Radio (CR) networks have been investigated to improve the bandwidth utilization through efficient channel allocations. Joint design of DVC and resource allocation in CR networks can provide a better solution to improve both resource efficiency and Quality of Service (QoS) performance of video transmissions. In this paper, we propose an efficient joint design scheme in which the interdependencies between cognitive radio resource management and the application-level characteristics of video traffic are jointly considered. Our studies show that the proposed scheme can significantly improve video transmission performance over CR networks.
Real-time Video Transmission Algorithm Based on Narrow and Variable Bandwidth

刘高平,李国胜,宋执环

DOI: https://doi.org/10.16136/j.joel.2012.03.026

2012-01-01

Abstract:A real-time video transmission algorithm using double dynamic buffers and double operation threads based on TCP protocol is proposed according to the characteristics of video stream and real-time surveillance applications. One video data buffer and one data sending buffer, which are managed respectively by one video data storing thread and one data sending thread, are set up in the transmitter. The video data storing thread dynamicaliy adjusts the video data buffer size and discards some video frames selectively during network congestion according to the maximal time waiting for sending and the network data transmission speed calculated actually in the data sending thread. The data sending thread sends vid- eo data to receiver and obtains video data one frame by one frame from the video data buffer, and calculates the network real-time data transmission speed. The experiment in simulated environment is given at last. The results show that the proposed algorithm is able to utilize network variable bandwidth in the greatest extent for transmitting video to receiver by real-time and ensures to play back smoothly in receiver, and can be applied effectively for real-time video surveillance in narrow and variable bandwidth networks.
Streaming video over Internet - issues and new development

Yaqin Zhang

1999-01-01

Abstract:Streaming video over Internet is quickly becoming a mainstream application with the explosive growth of Internet and advances in video representation algorithms and standardization such as highly efficient scalable video representation and finalization of Motion Picture Experts Group (MPEG4). Issues and challenges about streaming video over Internet protocol (IP) networks are discussed. New techniques on packetization, feedback control, rate-scalable coding, and error concealment are discussed. A new end-to-end architecture is proposed for both existing IP infrastructure as well as new generations of IP networks.
QoS Research of H.264 Video Transmission in Embedded Wireless LAN

LI Wen-xin,LI Yu-guang,HU Yan-su,MU De-jun

DOI: https://doi.org/10.3969/j.issn.1002-137x.2011.05.020

2011-01-01

Computer Science

Abstract:H.264 transmission issues in the Wireless LAN were studied and the existing video transmission strategy was improved according to the characteristic of embedded systems.First,a dynamic transmission algorithm based on feedback and buffer-driven was proposed on the server,and then a zero-buffer and slow-start algorithm for dynamic real-time playing was applied on the client.The improved strategy which takes the network,buffer and real-time into account not only ensures the real-time video transmission,but also provides the network QoS.And the experiments show that the two algorithms achieve satisfactory results.
Adaptive Rate Control for H. 264 Video

Chang-suk KO,Li-li YU,Qian ZHU,Qian-ming SHAO

DOI: https://doi.org/10.3969/j.issn.0427-7104.2006.01.016

2006-01-01

Abstract:Transmissions of real-time video always have packets loss by bandwidth limited in Internet network. Thus, it is an important and challenging task to improve the quality of multimedia transmission service. This paper proposes a new adaptive rate control scheme for H. 264 video, which based on packet loss decision. Experimental result demonstrate that the method mitigates the impact of bandwidth variety and is also improves the quality of multimedia transmission service.
On End-to-end Architecture for Transporting MPEG-4 Video over the Internet

DP Wu,YWT Hou,WW Zhu,HJ Lee,TH Chiang,YQ Zhang,HJ Chao

DOI: https://doi.org/10.1109/76.867930

IF: 5.859

2000-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:With the success of the Internet and flexibility of MPEG-4, transporting MPEG-4 video over the Internet is expected to be an important component of many multimedia applications in the near future. Video applications typically have delay and loss requirements, which cannot be adequately supported by the current Internet. Thus, it is a challenging problem to design an efficient MPEG-4 video delivery system that can maximize the perceptual quality while achieving high resource utilization. This paper addresses this problem by presenting an end-to-end architecture for transporting MPEG-4 video over the Internet. We present a framework for transporting MPEG-4 video, which includes source rate adaptation, packetization, feedback control, and error control. The main contributions of this paper are: (1) a feedback control algorithm based on the Real Time Protocol (RTP) and the Real Time Control Protocol (RTCP); (2) an adaptive source-encoding algorithm for MPEG-4 video which is able to adjust the output rate of MPEG-4 video to the desired rate; and (3) an efficient and robust packetization algorithm for MPEG video bit-streams at the sync layer for Internet transport. Simulation results show that our end-to-end transport architecture achieves good perceptual picture quality for MPEG-4 video under low bit-rate and varying network conditions and efficiently utilizes network resources.
Smoothed Transmission of Delay-Limited Fine Grained Scalable Video Streaming

ZHAO Anbang,CUI Huijuan,TANG Kun

DOI: https://doi.org/10.3321/j.issn:1000-0054.2007.04.019

2007-01-01

Abstract:Video transmissions through heterogeneous networks that can fluctuateanywhere and anytime require flexible video coding algorithms.The video coding should consider not only the coding efficiency but also the coding scalability.Scalable video coding presents a simple and flexible solution for video transmissions on heterogeneous networks.Although scalable video coding is flexible,the temporal variations in the heterogeneous networks cause problems for video transmissions.This paper studies the effects of temporal variations in networks on video transmissions to present a smoothed transmission solution under the condition of limited delay.The results show that the solution can improve the quality of the transmitted video.
Region-based Rate Control and Bit Allocation for Wireless Video Transmission.

Y Sun,I Ahmad,DD Li,YQ Zhang

DOI: https://doi.org/10.1109/tmm.2005.861296

IF: 7.3

2006-01-01

IEEE Transactions on Multimedia

Abstract:In this paper, we propose a joint source-channel region-based rate control algorithm for real-time video transmissions over wireless systems. During the video transmission, the channel throughput available to the video encoder in the wireless systems is inherently variable, due to the retransmission of the error packets using the automatic repeat request (ARQ) error control. The variable data rate of the wireless system is characterized by the packet-level Gilbert two-state Markov Model, the parameters of which are extracted from the statistical properties of the channel information obtained from the wireless channel simulator. The proposed algorithm adopts a fast but effective block-based segmentation method to extract the regions of interest. Unlike traditional bit allocation methods used in the region/content-based rate control, the algorithm exploits the most effective criteria "coding qualities" as quantitative factors to directly control bit allocation among different regions so as to achieve better visual quality in the regions of interest. The computational complexity of the algorithm is low making it suitable for real-time applications. Compared with the MPEG-4 rate control algorithm, our algorithm can effectively enhance the perceptual quality for the regions of interest and significantly reduce the number of frame skipping; thereby, improve the smoothness of the video.
Joint Power Control and Fec Unequal Error Protection for Scalable H.264 Video Transmission over Wireless Fading Channels

Chen Chi,Yu Zhang,Lele Wang

DOI: https://doi.org/10.1109/glocom.2009.5425489

2009-01-01

Abstract:H.264/AVC scalable video coding (SVC) is an up-to-date video compression standard. This paper deals with the issue of transmitting H.264 scalable video bitstreams over wireless fading channels. The contribution is twofold: Firstly, to exploit the importance of prioritized video packets in different temporal layer, quality layer and group of pictures (GOP), a simple and accurate performance metric, namely, layer-GOP-weighted expected zone of error propagation (LGW-EZEP) model is proposed. Secondly, a joint power control and forward error correction (FEC) unequal error protection (UEP) scheme is proposed to transmit the video streams over orthogonal frequency division multiplexing (OFDM) systems efficiently and robustly. Meanwhile, a new iterative algorithm is given to solve the joint optimization problem. Compared to other independent power control or FEC UEP schemes, the combined protecting scheme demonstrates stronger robustness and flexibility via various fading channels.

Real-time Transmission of H.264/AVC Video Based on IP

Key Technology Research And Analysis Of H.264/Avc Suitable For Wireless Network

Delay Constrained Self Congestion Control for FGS Video Streams

Research on H.264/SVC Compressed Video Communication in 3G

Study on significant technology of H.264 in mobile network

Extended application of scalable video coding methods

Adaptive network bandwidth control method for H.264 video stream transmission

Transmission of Scalable Video over Networks

Transporting Real-Time Video over the Internet: Challenges and Approaches

Scalable Video Coding and Transport over Broad-Band Wireless Networks

Adaptive Efficient Video Transmission over the Internet Based on Congestion Control and Rs Coding

A New FEC Scheme for Real-time Transmission of High Definition Video over IP Network

Video Transmission over Cognitive Radio Networks

Real-time Video Transmission Algorithm Based on Narrow and Variable Bandwidth

Streaming video over Internet - issues and new development

QoS Research of H.264 Video Transmission in Embedded Wireless LAN

Adaptive Rate Control for H. 264 Video

On End-to-end Architecture for Transporting MPEG-4 Video over the Internet

Smoothed Transmission of Delay-Limited Fine Grained Scalable Video Streaming

Region-based Rate Control and Bit Allocation for Wireless Video Transmission.

Joint Power Control and Fec Unequal Error Protection for Scalable H.264 Video Transmission over Wireless Fading Channels