Introduction to the Issue on Video Coding: HEVC and Beyond

Yun He,Joern Ostermann,Marek Domanski,Oscar C. Au,Nam Ling

DOI: https://doi.org/10.1109/jstsp.2013.2286851

IF: 7.695

2013-01-01

IEEE Journal of Selected Topics in Signal Processing

Abstract:The 19 papers in this issue focus on High Efficiency Video Coding.

What problem does this paper attempt to address?

Introduction to the Issue on Emerging Technologies for Video Compression

David Bull,Edward J. Delp,S. Takamura,Thomas Wiegand,Feng Wu

DOI: https://doi.org/10.1109/jstsp.2011.2170331

IF: 7.695

2011-01-01

IEEE Journal of Selected Topics in Signal Processing

Abstract:The ten papers in this special issue focus on emerging technologies for video compression. There are contributions related to four key research areas: 1) the merging HEVC standardization process; 2)advances in 3-D coding; 3) quality assessment for next generation codecs; and 4) new compression methods exploiting spatio-temporal content analysis and synthesis.
Recent Advances on HEVC Inter-Frame Coding: From Optimization to Implementation and Beyond

Yongfei Zhang,Chao Zhang,Rui Fan,Siwei Ma,Zhibo Chen,C.-C. Jay Kuo

DOI: https://doi.org/10.1109/tcsvt.2019.2954474

IF: 5.859

2020-11-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:High Efficiency Video Coding (HEVC) has doubled the video compression ratio with equivalent subjective quality as compared to its predecessor H.264/AVC. The significant coding efficiency improvement is attributed to many new techniques. Inter-frame coding is one of the most powerful yet complicated techniques therein and has posed high computational burden thus main obstacle in HEVC-based real-time applications. Recently, plenty of research has been done to optimize the inter-frame coding, either to reduce the complexity for real-time applications, or to further enhance the encoding efficiency. In this paper, we provide a comprehensive review of the state-of-the-art techniques for HEVC inter-frame coding from three aspects, namely fast inter coding solutions, implementation on different hardware platforms as well as advanced inter coding techniques. More specifically, different algorithms in each aspect are further subdivided into sub-categories and compared in terms of pros, cons, coding efficiency and coding complexity. To the best of our knowledge, this is the first such comprehensive review of the recent advances of the inter-frame coding for HEVC and hopefully it would help the improvement, implementation and applications of HEVC as well as the ongoing development of the next generation video coding standard.

engineering, electrical & electronic
Key Technology Research And Analysis Of H.264/Avc Suitable For Wireless Network

Yun-Peng Liu,San-Yuan Zhang,Shu-Chang Xu,Yin Zhang

2009-01-01

Abstract:The emergence of H.264/AVC video compression standard provides better support functions for wireless network. The characteristics of limited bandwidth, high error rate of wireless channel and the constraints of computing and storage capacity of most mobile devices make the key technology of video codec in error resilience strategies, rate control, mode decision and scalable extension more important. In this paper, we first analyze the main and popular strategies in the key technology, and then we propose a method to choose and combine these strategies to validate the results and performance by experiment. Experiment shows the rational use of these technologies improves the quality of video transmission and provides reference for the video service evaluation.
An Introduction to High Efficiency Video Coding Range Extensions

Bin Li,Jizheng Xu

DOI: https://doi.org/10.3969/j.issn.1673-5188.2016.01.002

2019-01-01

Abstract:High Efficiency Video Coding（HEVC） is the latest international video coding standard, which can provide the similar quality with about half bandwidth compared with its predecessor, H.264/MPEG-4 AVC. To meet the requirement of higher bit depth coding and more chroma sampling formats, range extensions of HEVC were developed. This paper introduces the coding tools in HEVC range extensions and provides experimental results to compare HEVC range extensions with previous video coding standards. Experimental results show that HEVC range extensions improve coding efficiency much over H.264/MPEG-4 AVC High Predictive profile, especially for 4K sequences.
Coding Tools Investigation for Next Generation Video Coding Based on Hevc

Jianle Chen,Ying Chen,Marta Karczewicz,Xiang Li,Hongbin Liu,Li Zhang,Xin Zhao

DOI: https://doi.org/10.1117/12.2193681

2015-01-01

Abstract:The new state-of-the-art video coding standard, H.265/HEVC, has been finalized in 2013 and it achieves roughly 50% bit rate saving compared to its predecessor, H.264/MPEG-4 AVC. This paper provides the evidence that there is still potential for further coding efficiency improvements. A brief overview of HEVC is firstly given in the paper. Then, our improvements on each main module of HEVC are presented. For instance, the recursive quadtree block structure is extended to support larger coding unit and transform unit. The motion information prediction scheme is improved by advanced temporal motion vector prediction, which inherits the motion information of each small block within a large block from a temporal reference picture. Cross component prediction with linear prediction model improves intra prediction and overlapped block motion compensation improves the efficiency of inter prediction. Furthermore, coding of both intra and inter prediction residual is improved by adaptive multiple transform technique. Finally, in addition to deblocking filter and SAO, adaptive loop filter is applied to further enhance the reconstructed picture quality. This paper describes above-mentioned techniques in detail and evaluates their coding performance benefits based on the common test condition during HEVC development. The simulation results show that significant performance improvement over HEVC standard can be achieved, especially for the high resolution video materials.
Overview Of The Multiview High Efficiency Video Coding (Mv-Hevc) Standard

Miska M. Hannuksela,Ye Yan,Xuehui Huang,Houqiang Li

DOI: https://doi.org/10.1109/ICIP.2015.7351182

2015-01-01

Abstract:This paper reviews the multiview extension (MV-HEVC) of the High Efficiency Video Coding (HEVC) standard. MV-HEVC is capable of multiview video coding with or without accompanying depth views. The key design concepts and design elements of MV-HEVC are described in the paper. Furthermore, the features and characteristics of MV-HEVC compared to other standardized video codec extensions for three-dimensional (3D) video coding are reviewed.
Lossy and Lossless Intra Coding Performance Evaluation: Hevc, H.264/Avc, Jpeg 2000 and Jpeg Ls

Qi Cai,Li Song,Guichun Li,Nam Ling

2012-01-01

Abstract:High Efficiency Video Coding (HEVC), the latest international standard of video coding under development, has shown a major breakthrough with regards to compression efficiency. But most of the currently published studies were intended to evaluate the overall R-D performance of HEVC in comparison to prior H.264/AVC video coding standard. In this paper, we present sufficient rate-distortion performance comparisons of image coding between the HEVC and previous image and intra-only video coding standards, including JPEG 2000, JPEG LS and H.264/AVC intra high profile. In addition, some recently reported performances of HEVC are also reviewed and compared. The coding simulations are conducted on a set of recommended video sequences during the development of the HEVC standard. Experimental results show that HEVC can offer consistent performance gains over a wide range of bitrates on natural video sequences as expected. Besides, we also present the comparison results of all these standards in the scenario of lossless image coding.
Performance Overview of the Latest Video Coding Proposals: HEVC, JEM and VVC

Miguel O Martínez-Rach,Héctor Migallón,Otoniel López-Granado,Vicente Galiano,Manuel P Malumbres,Miguel O. Martínez-Rach,Manuel P. Malumbres

DOI: https://doi.org/10.3390/jimaging7020039

2021-02-22

Journal of Imaging

Abstract:The audiovisual entertainment industry has entered a race to find the video encoder offering the best Rate/Distortion (R/D) performance for high-quality high-definition video content. The challenge consists in providing a moderate to low computational/hardware complexity encoder able to run Ultra High-Definition (UHD) video formats of different flavours (360°, AR/VR, etc.) with state-of-the-art R/D performance results. It is necessary to evaluate not only R/D performance, a highly important feature, but also the complexity of future video encoders. New coding tools offering a small increase in R/D performance at the cost of greater complexity are being advanced with caution. We performed a detailed analysis of two evolutions of High Efficiency Video Coding (HEVC) video standards, Joint Exploration Model (JEM) and Versatile Video Coding (VVC), in terms of both R/D performance and complexity. The results show how VVC, which represents the new direction of future standards, has, for the time being, sacrificed R/D performance in order to significantly reduce overall coding/decoding complexity.
Overview of the Versatile Video Coding (VVC) Standard and its Applications

Benjamin Bross,Ye-Kui Wang,Yan Ye,Shan Liu,Jianle Chen,Gary J. Sullivan,Jens-Rainer Ohm

DOI: https://doi.org/10.1109/tcsvt.2021.3101953

IF: 5.859

2021-10-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Versatile Video Coding (VVC) was finalized in July 2020 as the most recent international video coding standard. It was developed by the Joint Video Experts Team (JVET) of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG) to serve an ever-growing need for improved video compression as well as to support a wider variety of today's media content and emerging applications. This paper provides an overview of the novel technical features for new applications and the core compression technologies for achieving significant bit rate reductions in the neighborhood of 50% over its predecessor for equal video quality, the High Efficiency Video Coding (HEVC) standard, and 75% over the currently most-used format, the Advanced Video Coding (AVC) standard. It is explained how these new features in VVC provide greater versatility for applications. Highlighted applications include video with resolutions beyond standard- and high-definition, video with high dynamic range and wide color gamut, adaptive streaming with resolution changes, computer-generated and screen-captured video, ultralow-delay streaming, 360° immersive video, and multilayer coding e.g., for scalability. Furthermore, early implementations are presented to show that the new VVC standard is implementable and ready for real-world deployment.

engineering, electrical & electronic
Visual Attention-aware High Dynamic Range Quantization for HEVC Video Coding

Yi Liu,Naty Sidaty,Wassim Hamidouche,Olivier Déforges,Cheolkon Jung,Olivier Deforges

DOI: https://doi.org/10.1109/tcsvt.2021.3131474

IF: 5.859

2021-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:Emerging HDR videos enable the recording of adequate luminance information and representing realistic scenes to the audience. Due to the high precision of the HDR data recorded in the floating-point format, a quantization process is required to convert HDR data to integer data for compatibility with current transmission and display systems. In this study, a novel attention-aware quantization method is presented that attempts to preserve the contrast details in the region of interest of the human visual system. This method was applied in the context of HDR video coding. The proposed coding solution was compared with the current anchor solution in terms of the quality of the reconstructed video. Experimental results show that the proposed solution is able to improve the visual quality of encoded video with respect to the anchor solution. Additionally, the proposed solution achieves a bit-rate gain over the anchor with reference to the objective evaluation results.

engineering, electrical & electronic
Compression Performance Of High Efficiency Video Coding (Hevc) Working Draft 4

Bin Li,Gary J. Sullivan,Jizheng Xu

DOI: https://doi.org/10.1109/ISCAS.2012.6272183

2012-01-01

Abstract:This paper presents the results of compression comparison tests between the current state of the emerging High Efficiency Video Coding (HEVC) draft standard and the current dominant standard H.264/MPEG-4 AVC (High Profile) as an anchor reference. The conditions used for the comparison tests were designed to reflect relevant application scenarios and to enable a fair comparison to the maximum extent feasible, i.e. using comparable quantization settings, reference frame buffering, etc. The testing was generally configured in favour of using a relatively strong H.264/MPEG-4 AVC anchor reference. Several of the encoder optimizations currently found in the HEVC software are tested and shown to be helpful to improve the H.264/MPEG-4 AVC anchor performance. When compared to the improved anchor encoder configurations, the HEVC draft design currently provides a bit rate savings for equal PSNR of about 39% for random access applications, 44% for low-delay use, and 25% for all-intra use.
Error Concealment Based Foreground and Background for HEVC

LIU Chang,MA Ran,LIU Deyang,ZHANG Zhaoyang

DOI: https://doi.org/10.3969/j.issn.1002-8692.2012.15.003

2012-01-01

Abstract:The next-generation video coding standard,called High Efficiency Video Coding(HEVC),uses quardtree structures to encode the video efficiently,which is especially adopt for HD video.However,the reliability of network channel may lead to the loss or corruption of video data.And the encoding characteristics of HEVC determine that error data may appear in the coding blocks with different size.Therefore,the characteristics of different size blocks are analyzed in this paper.Then,a distinction between foreground and background is made.Especially,the OBMA algorithm is used to detect that whether the error block is belong to boundaries or moving objects,different error concealment methods for error blocks in different regions are proposed at last.
Brief analysis of the H.264 coding standard

Wu Yun,Zhao Yong,Li Jianshi

DOI: https://doi.org/10.1109/iihmsp.2007.4457675

2007-01-01

Abstract:H.264/AVC is the current video standardization project of the ITU-T Video Coding Experts Group (VCEG) and the ISO/IEC Moving Picture Experts Group (MPEG). H.264/AVC represents a major step forward in the development of video coding standards. In this paper, the authors briefly introduced a technical overview of H.264/AVC standard and proposed the related coding tools. At the last section, the authors compared the H.264/AVC standard with other prior coding standards. The results show that H.264/AVC standard will enable new applications and business opportunities to be developed.
The Future of Video Coding

Nam Ling,C. -C. Jay Kuo,Gary J. Sullivan,Dong Xu,Shan Liu,Hsueh-Ming Hang,Wen-Hsiao Peng,Jiaying Liu

DOI: https://doi.org/10.1561/116.00000044

2022-01-01

APSIPA Transactions on Signal and Information Processing

Abstract:This article summarizes the panel discussion on "The Future of Video Coding," organized by the U.S. Local Chapter of APSIPA on April 24, 2021. This panel brought together world leading experts in video coding to discuss and debate this hot topic. The speakers are leaders from various video coding fields, ranging from video coding standards, visual quality, deep learning approaches, screen content coding, reinforcement learning, rate-control, video coding for machines, and more. The panel discussed and debated different future issues related to video coding, including but not limited to, the emerging areas within the next 5 years, the trend and role of deep-based coding, the impact of visual quality assessment, the role for academia, the advice for graduate students, and more. The key points of the panellists' opinions are highlighted in italics.
Distributed Video Coding: Trends and Perspectives

Frederic Dufaux,Wen Gao,Stefano Tubaro,Anthony Vetro

DOI: https://doi.org/10.1155/2009/508167

IF: 2.399

2009-01-01

EURASIP Journal on Image and Video Processing

Abstract:This paper surveys recent trends and perspectives in distributed video coding. More specifically, the status and potential benefits of distributed video coding in terms of coding efficiency, complexity, error resilience, and scalability are reviewed. Multiview video and applications beyond coding are also considered. In addition, recent contributions in these areas, more thoroughly explored in the papers of the present special issue, are also described.
Evaluation of Beyond-Hevc Entropy Coding Methods for Dct Transform Coefficients

Han Zhang,Li Song,Xiaokang Yang,Zhengyi Luo

DOI: https://doi.org/10.1109/vcip.2016.7805533

2016-01-01

Abstract:Entropy coding, which acts as one of the most important compression tools in video coding standard, had been improved step by step for HEVC. There are also several advanced methods which provide better performance than current solutions of HEVC proposed during the standardization of HEVC. However, these methods are all tested in different conditions. Comprehensive evaluation of these advanced methods under a common scenario is desired to indicate where the potential improvement of entropy coding may come from for next generation video codec. In this paper, we first introduce several advanced entropy coding methods for DCT transform coefficients, which aim to improve CABAC performance from two aspects - context modeling and probability updating. Then some modifications based on these original ones are presented. Comprehensive comparison of these methods is conducted under common test conditions. Besides, some combined methods of these two aspects are also tested. Experimental results show that all individual approaches can achieve coding gain and two new combined methods can reduce the BD-Rate up to 1.7%, 1.2% and 1.0% on common test sequences and 1.4%, 1.0% and 1.1% on 4K sequences under all intra, random access and low delay configurations, respectively.
Image and Video Compression with Neural Networks: A Review

Siwei Ma,Xinfeng Zhang,Chuanmin Jia,Zhenghui Zhao,Shiqi Wang,Shanshe Wang

DOI: https://doi.org/10.1109/tcsvt.2019.2910119

IF: 5.859

2020-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:In recent years, the image and video coding technologies have advanced by leaps and bounds. However, due to the popularization of image and video acquisition devices, the growth rate of image and video data is far beyond the improvement of the compression ratio. In particular, it has been widely recognized that there are increasing challenges of pursuing further coding performance improvement within the traditional hybrid coding framework. Deep convolution neural network which makes the neural network resurge in recent years and has achieved great success in both artificial intelligent and signal processing fields, also provides a novel and promising solution for image and video compression. In this paper, we provide a systematic, comprehensive and up-to-date review of neural network-based image and video compression techniques. The evolution and development of neural network-based compression methodologies are introduced for images and video respectively. More specifically, the cutting-edge video coding techniques by leveraging deep learning and HEVC framework are presented and discussed, which promote the state-of-the-art video coding performance substantially. Moreover, the end-to-end image and video coding frameworks based on neural networks are also reviewed, revealing interesting explorations on next generation image and video coding frameworks/standards. The most significant research works on the image and video coding related topics using neural networks are highlighted, and future trends are also envisioned. In particular, the joint compression on semantic and visual information is tentatively explored to formulate high efficiency signal representation structure for both human vision and machine vision, which are the two dominant signal receptors in the age of artificial intelligence.
CTU Depth Decision Algorithms for HEVC: A Survey

Ekrem Cetinkaya,Hadi Amirpour,Mohammad Ghanbari,Christian Timmerer

DOI: https://doi.org/10.1016/j.image.2021.116442

2021-06-24

Abstract:High-Efficiency Video Coding (HEVC) surpasses its predecessors in encoding efficiency by introducing new coding tools at the cost of an increased encoding time-complexity. The Coding Tree Unit (CTU) is the main building block used in HEVC. In the HEVC standard, frames are divided into CTUs with the predetermined size of up to 64x64 pixels. Each CTU is then divided recursively into a number of equally sized square areas, known as Coding Units (CUs). Although this diversity of frame partitioning increases encoding efficiency, it also causes an increase in the time complexity due to the increased number of ways to find the optimal partitioning. To address this complexity, numerous algorithms have been proposed to eliminate unnecessary searches during partitioning CTUs by exploiting the correlation in the video. In this paper, existing CTU depth decision algorithms for HEVC are surveyed. These algorithms are categorized into two groups, namely statistics and machine learning approaches. Statistics approaches are further subdivided into neighboring and inherent approaches. Neighboring approaches exploit the similarity between adjacent CTUs to limit the depth range of the current CTU, while inherent approaches use only the available information within the current CTU. Machine learning approaches try to extract and exploit similarities implicitly. Traditional methods like support vector machines or random forests use manually selected features, while recently proposed deep learning methods extract features during training. Finally, this paper discusses extending these methods to more recent video coding formats such as Versatile Video Coding (VVC) and AOMedia Video 1(AV1).

Multimedia
Abeydeera, M., Karunaratne, M., Karunaratne, G., De Silva, K., and Pasqual, A., 4K Real-Time HEVC Decoder on an FPGA; TCSVT Jan. 2016 236-249 Abramowski, A., see Pastuszak, G …

NV Boulgouris,DR Bull,M Cagnazzo,A Cavallaro,G Cheung,A Roy-Chowdhury,P Comesana-Alfaro,S Du,S Erturk,M Flierl,GL Foresti,G Hua,Z Li,W Lin,S Ma,PK Meher,D Mukherjee,A Pizurica,A Prati,P Remagnino,A Ross,S Satoh,A Savakis,H Schwarz,L Shao,S Shirmohammadi,G Valenzise,M Wang,Z Wang,Y Wen,D Xu,J Yuan,Y Yuan

IF: 5.859

2016-01-01

IEEE Transactions on Circuits and Systems for Video Technology

Abstract:This index covers all technical items — papers, correspondence, reviews, etc. —that appeared in this periodical during 2016, and items from previous years that were commented upon or corrected in 2016. Departments and other items may also be covered if they have been judged to have archival value. The Author Index contains the primary entry for each item, listed under the first author's name. The primary entry includes the coauthors' names, the title of the paper or other item, and its location, specified by the publication abbreviation, year, month, and inclusive pagination. The Subject Index contains entries describing the item under all appropriate subject headings, plus the first author's name, the publication abbreviation, month, and year, and inclusive pages. Note that the item title is found only under the primary entry in the Author Index … Abeydeera, M., Karunaratne, M., Karunaratne, G., De Silva, K., and Pasqual, A., 4K Real …
A Survey on Recent Advances in Digital Video Technology

胡栋,郑宝玉

DOI: https://doi.org/10.3321/j.issn:1000-436x.2003.07.014

2003-01-01

Abstract:This paper reviews some recent advances in the video techniques such as video coding, video stream analysis, and video stream transportation etc. The survey clearly shows that while the standard compliant video coding is still attractive in application, new direction are wavelet/subband based video coding, and object oriented coding. The study on robust video transmission over IP and wireless network is the most challenging topic and of great importance. Besides, video stream analysis, image database technology and video watermark also possess bright application prospect. The paper also gives a brief introduction on the progresses and technical features of the newest standard H.26L of JVT.

Introduction to the Issue on Video Coding: HEVC and Beyond

Introduction to the Issue on Emerging Technologies for Video Compression

Recent Advances on HEVC Inter-Frame Coding: From Optimization to Implementation and Beyond

Key Technology Research And Analysis Of H.264/Avc Suitable For Wireless Network

An Introduction to High Efficiency Video Coding Range Extensions

Coding Tools Investigation for Next Generation Video Coding Based on Hevc

Overview Of The Multiview High Efficiency Video Coding (Mv-Hevc) Standard

Lossy and Lossless Intra Coding Performance Evaluation: Hevc, H.264/Avc, Jpeg 2000 and Jpeg Ls

Performance Overview of the Latest Video Coding Proposals: HEVC, JEM and VVC

Overview of the Versatile Video Coding (VVC) Standard and its Applications

Visual Attention-aware High Dynamic Range Quantization for HEVC Video Coding

Compression Performance Of High Efficiency Video Coding (Hevc) Working Draft 4

Error Concealment Based Foreground and Background for HEVC

Brief analysis of the H.264 coding standard

The Future of Video Coding

Distributed Video Coding: Trends and Perspectives

Evaluation of Beyond-Hevc Entropy Coding Methods for Dct Transform Coefficients

Image and Video Compression with Neural Networks: A Review

CTU Depth Decision Algorithms for HEVC: A Survey

Abeydeera, M., Karunaratne, M., Karunaratne, G., De Silva, K., and Pasqual, A., 4K Real-Time HEVC Decoder on an FPGA; TCSVT Jan. 2016 236-249 Abramowski, A., see Pastuszak, G …

A Survey on Recent Advances in Digital Video Technology