Benchmarking real-time HEVC streaming

James Nightingale, Qi Wang, Christos Grecos

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

5 Citations (Scopus)

Abstract

Work towards the standardisation of High Efficiency Video Coding (HEVC), the next generation video coding scheme, is currently gaining pace. HEVC offers the prospect of a 50% improvement in compression over the current H.264 Advanced Video Coding standard (H.264/AVC). Thus far, work on HEVC has concentrated on improvements to the coding efficiency and has not yet addressed transmission in networks other than to mandate byte stream compliance with Annex B of H.264/AVC. For practical networked HEVC applications a number of essential building blocks have yet to be defined. In this work, we design and prototype a real-time HEVC streaming system and empirically evaluate its performance, in particular we consider the robustness of the current Test Model under Consideration (TMuC HM4.0) for HEVC to packet loss caused by a reduction in available bandwidth both in terms of decoder resilience and degradation in perceptual video quality. A NAL unit packetisation and streaming framework for HEVC encoded video streams is designed, implemented and empirically tested in a number of streaming environments including wired, wireless, single path and multiple path network scenarios. As a first step the HEVC decoder's error resilience is tested under a comprehensive set of packet loss conditions and a simple error concealment method for HEVC is implemented. Similarly to H.264 encoded streams, the size and distribution of NAL units within an HEVC stream and the nature of the NAL unit dependencies influences the packetisation and streaming strategies which may be employed for such streams. The relationships between HEVC encoding mode and the quality of the received video are shown under a wide range of bandwidth constraints. HEVC streaming is evaluated in both single and multipath network configuration scenarios. Through the use of extensive experimentation, we establish a comprehensive set of benchmarks for HEVC streaming in loss prone network environments. We show the visual quality reduction in terms of PSNR which results from a reduction in available bandwidth. To the best of our knowledge, this is the first time that such a fully functional streaming system for HEVC, together with the benchmark evaluation results, has been reported. This study will open up more timely research opportunities in this cutting edge area.

LanguageEnglish
Title of host publicationReal-Time Image and Video Processing 2012
Number of pages14
Volume8437
DOIs
Publication statusPublished - 12 Jun 2012
EventReal-Time Image and Video Processing 2012 - Brussels, Belgium
Duration: 19 Apr 201219 Apr 2012

Conference

ConferenceReal-Time Image and Video Processing 2012
CountryBelgium
CityBrussels
Period19/04/1219/04/12

Fingerprint

Video Coding
Benchmarking
Image coding
Streaming
High Efficiency
Real-time
Bandwidth
Packet Loss
Packet loss
Unit
Error Resilience
Loss Networks
Coding errors
Error Concealment
Benchmark
Scenarios
Path
H.264/AVC
Video Quality
Resilience

Keywords

  • benchmarking
  • HEVC
  • testbed
  • video streaming

Cite this

Nightingale, J., Wang, Q., & Grecos, C. (2012). Benchmarking real-time HEVC streaming. In Real-Time Image and Video Processing 2012 (Vol. 8437). [84370D] https://doi.org/10.1117/12.921406
Nightingale, James ; Wang, Qi ; Grecos, Christos. / Benchmarking real-time HEVC streaming. Real-Time Image and Video Processing 2012. Vol. 8437 2012.
@inproceedings{7d70c8bf989d4b8a9a6c5125a2f02bf7,
title = "Benchmarking real-time HEVC streaming",
abstract = "Work towards the standardisation of High Efficiency Video Coding (HEVC), the next generation video coding scheme, is currently gaining pace. HEVC offers the prospect of a 50{\%} improvement in compression over the current H.264 Advanced Video Coding standard (H.264/AVC). Thus far, work on HEVC has concentrated on improvements to the coding efficiency and has not yet addressed transmission in networks other than to mandate byte stream compliance with Annex B of H.264/AVC. For practical networked HEVC applications a number of essential building blocks have yet to be defined. In this work, we design and prototype a real-time HEVC streaming system and empirically evaluate its performance, in particular we consider the robustness of the current Test Model under Consideration (TMuC HM4.0) for HEVC to packet loss caused by a reduction in available bandwidth both in terms of decoder resilience and degradation in perceptual video quality. A NAL unit packetisation and streaming framework for HEVC encoded video streams is designed, implemented and empirically tested in a number of streaming environments including wired, wireless, single path and multiple path network scenarios. As a first step the HEVC decoder's error resilience is tested under a comprehensive set of packet loss conditions and a simple error concealment method for HEVC is implemented. Similarly to H.264 encoded streams, the size and distribution of NAL units within an HEVC stream and the nature of the NAL unit dependencies influences the packetisation and streaming strategies which may be employed for such streams. The relationships between HEVC encoding mode and the quality of the received video are shown under a wide range of bandwidth constraints. HEVC streaming is evaluated in both single and multipath network configuration scenarios. Through the use of extensive experimentation, we establish a comprehensive set of benchmarks for HEVC streaming in loss prone network environments. We show the visual quality reduction in terms of PSNR which results from a reduction in available bandwidth. To the best of our knowledge, this is the first time that such a fully functional streaming system for HEVC, together with the benchmark evaluation results, has been reported. This study will open up more timely research opportunities in this cutting edge area.",
keywords = "benchmarking, HEVC, testbed, video streaming",
author = "James Nightingale and Qi Wang and Christos Grecos",
year = "2012",
month = "6",
day = "12",
doi = "10.1117/12.921406",
language = "English",
isbn = "9780819491299",
volume = "8437",
booktitle = "Real-Time Image and Video Processing 2012",

}

Nightingale, J, Wang, Q & Grecos, C 2012, Benchmarking real-time HEVC streaming. in Real-Time Image and Video Processing 2012. vol. 8437, 84370D, Real-Time Image and Video Processing 2012, Brussels, Belgium, 19/04/12. https://doi.org/10.1117/12.921406

Benchmarking real-time HEVC streaming. / Nightingale, James; Wang, Qi; Grecos, Christos.

Real-Time Image and Video Processing 2012. Vol. 8437 2012. 84370D.

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

TY - GEN

T1 - Benchmarking real-time HEVC streaming

AU - Nightingale, James

AU - Wang, Qi

AU - Grecos, Christos

PY - 2012/6/12

Y1 - 2012/6/12

N2 - Work towards the standardisation of High Efficiency Video Coding (HEVC), the next generation video coding scheme, is currently gaining pace. HEVC offers the prospect of a 50% improvement in compression over the current H.264 Advanced Video Coding standard (H.264/AVC). Thus far, work on HEVC has concentrated on improvements to the coding efficiency and has not yet addressed transmission in networks other than to mandate byte stream compliance with Annex B of H.264/AVC. For practical networked HEVC applications a number of essential building blocks have yet to be defined. In this work, we design and prototype a real-time HEVC streaming system and empirically evaluate its performance, in particular we consider the robustness of the current Test Model under Consideration (TMuC HM4.0) for HEVC to packet loss caused by a reduction in available bandwidth both in terms of decoder resilience and degradation in perceptual video quality. A NAL unit packetisation and streaming framework for HEVC encoded video streams is designed, implemented and empirically tested in a number of streaming environments including wired, wireless, single path and multiple path network scenarios. As a first step the HEVC decoder's error resilience is tested under a comprehensive set of packet loss conditions and a simple error concealment method for HEVC is implemented. Similarly to H.264 encoded streams, the size and distribution of NAL units within an HEVC stream and the nature of the NAL unit dependencies influences the packetisation and streaming strategies which may be employed for such streams. The relationships between HEVC encoding mode and the quality of the received video are shown under a wide range of bandwidth constraints. HEVC streaming is evaluated in both single and multipath network configuration scenarios. Through the use of extensive experimentation, we establish a comprehensive set of benchmarks for HEVC streaming in loss prone network environments. We show the visual quality reduction in terms of PSNR which results from a reduction in available bandwidth. To the best of our knowledge, this is the first time that such a fully functional streaming system for HEVC, together with the benchmark evaluation results, has been reported. This study will open up more timely research opportunities in this cutting edge area.

AB - Work towards the standardisation of High Efficiency Video Coding (HEVC), the next generation video coding scheme, is currently gaining pace. HEVC offers the prospect of a 50% improvement in compression over the current H.264 Advanced Video Coding standard (H.264/AVC). Thus far, work on HEVC has concentrated on improvements to the coding efficiency and has not yet addressed transmission in networks other than to mandate byte stream compliance with Annex B of H.264/AVC. For practical networked HEVC applications a number of essential building blocks have yet to be defined. In this work, we design and prototype a real-time HEVC streaming system and empirically evaluate its performance, in particular we consider the robustness of the current Test Model under Consideration (TMuC HM4.0) for HEVC to packet loss caused by a reduction in available bandwidth both in terms of decoder resilience and degradation in perceptual video quality. A NAL unit packetisation and streaming framework for HEVC encoded video streams is designed, implemented and empirically tested in a number of streaming environments including wired, wireless, single path and multiple path network scenarios. As a first step the HEVC decoder's error resilience is tested under a comprehensive set of packet loss conditions and a simple error concealment method for HEVC is implemented. Similarly to H.264 encoded streams, the size and distribution of NAL units within an HEVC stream and the nature of the NAL unit dependencies influences the packetisation and streaming strategies which may be employed for such streams. The relationships between HEVC encoding mode and the quality of the received video are shown under a wide range of bandwidth constraints. HEVC streaming is evaluated in both single and multipath network configuration scenarios. Through the use of extensive experimentation, we establish a comprehensive set of benchmarks for HEVC streaming in loss prone network environments. We show the visual quality reduction in terms of PSNR which results from a reduction in available bandwidth. To the best of our knowledge, this is the first time that such a fully functional streaming system for HEVC, together with the benchmark evaluation results, has been reported. This study will open up more timely research opportunities in this cutting edge area.

KW - benchmarking

KW - HEVC

KW - testbed

KW - video streaming

UR - http://www.scopus.com/inward/record.url?scp=84861926523&partnerID=8YFLogxK

U2 - 10.1117/12.921406

DO - 10.1117/12.921406

M3 - Conference contribution book

SN - 9780819491299

VL - 8437

BT - Real-Time Image and Video Processing 2012

ER -

Nightingale J, Wang Q, Grecos C. Benchmarking real-time HEVC streaming. In Real-Time Image and Video Processing 2012. Vol. 8437. 2012. 84370D https://doi.org/10.1117/12.921406