View-popularity-driven joint source and channel coding of view and rate scalable multi-view video

Jacob Chakareski, Vladan Velisavljevic, Vladimir Stankovic

Research output: Contribution to journalArticle

14 Citations (Scopus)
89 Downloads (Pure)

Abstract

We study the scenario of multicasting multi-view video content, recorded in the video plus depth format, to a collection of heterogeneous clients featuring Internet access links of diverse packet loss and transmission bandwidth values. We design a popularity-aware joint source-channel coding optimization framework that allocates source and channel coding rates to the captured content, such that the aggregate video quality of the reconstructed content across the client population is maximized, for the given packet loss and bandwidth characteristics of the clients and their view selection preferences. The source coding component of our framework features a procedure for generating a view and rate embedded bitstream that is optimally decodable at multiple data rates and accounts for the different popularity of diverse video perspectives of the scene of interest, among the clients. The channel coding component of our framework comprises an expanding-window rateless coding procedure that optimally allocates parity protection bits to the source encoded layers, in order to address packet loss across the unreliable client access links. We develop an optimization method that jointly computes the source and channel coding decisions of our framework, and also design a fast local-search-based solution that exhibits a negligible performance loss relative to the full optimization. We carry out comprehensive simulation experiments and demonstrate significant performance gains over competitive stateof- the-art methods (based on H.264/AVC and network coding, and H.264/SVC and our own channel coding procedure), across different scenario settings and parameter values.
Original languageEnglish
Pages (from-to)474 - 486
Number of pages14
JournalIEEE Journal on Selected Topics in Signal Processing
Volume9
Issue number3
Early online date11 Feb 2015
DOIs
Publication statusPublished - 30 Apr 2015

Fingerprint

Channel coding
Packet loss
Bandwidth
Multicasting
Network coding
Telecommunication links
Internet
Experiments

Keywords

  • rateless codes
  • view and rate scalable encoding
  • channel coding
  • bandwidth
  • streaming media

Cite this

@article{54f0db6e9688422ea77e52be2e3c28c4,
title = "View-popularity-driven joint source and channel coding of view and rate scalable multi-view video",
abstract = "We study the scenario of multicasting multi-view video content, recorded in the video plus depth format, to a collection of heterogeneous clients featuring Internet access links of diverse packet loss and transmission bandwidth values. We design a popularity-aware joint source-channel coding optimization framework that allocates source and channel coding rates to the captured content, such that the aggregate video quality of the reconstructed content across the client population is maximized, for the given packet loss and bandwidth characteristics of the clients and their view selection preferences. The source coding component of our framework features a procedure for generating a view and rate embedded bitstream that is optimally decodable at multiple data rates and accounts for the different popularity of diverse video perspectives of the scene of interest, among the clients. The channel coding component of our framework comprises an expanding-window rateless coding procedure that optimally allocates parity protection bits to the source encoded layers, in order to address packet loss across the unreliable client access links. We develop an optimization method that jointly computes the source and channel coding decisions of our framework, and also design a fast local-search-based solution that exhibits a negligible performance loss relative to the full optimization. We carry out comprehensive simulation experiments and demonstrate significant performance gains over competitive stateof- the-art methods (based on H.264/AVC and network coding, and H.264/SVC and our own channel coding procedure), across different scenario settings and parameter values.",
keywords = "rateless codes, view and rate scalable encoding, channel coding, bandwidth, streaming media",
author = "Jacob Chakareski and Vladan Velisavljevic and Vladimir Stankovic",
note = "(c) 2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.",
year = "2015",
month = "4",
day = "30",
doi = "10.1109/JSTSP.2015.2402633",
language = "English",
volume = "9",
pages = "474 -- 486",
journal = "IEEE Journal on Selected Topics in Signal Processing",
issn = "1932-4553",
number = "3",

}

View-popularity-driven joint source and channel coding of view and rate scalable multi-view video. / Chakareski, Jacob; Velisavljevic, Vladan; Stankovic, Vladimir.

In: IEEE Journal on Selected Topics in Signal Processing, Vol. 9, No. 3, 30.04.2015, p. 474 - 486 .

Research output: Contribution to journalArticle

TY - JOUR

T1 - View-popularity-driven joint source and channel coding of view and rate scalable multi-view video

AU - Chakareski, Jacob

AU - Velisavljevic, Vladan

AU - Stankovic, Vladimir

N1 - (c) 2015 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other users, including reprinting/ republishing this material for advertising or promotional purposes, creating new collective works for resale or redistribution to servers or lists, or reuse of any copyrighted components of this work in other works.

PY - 2015/4/30

Y1 - 2015/4/30

N2 - We study the scenario of multicasting multi-view video content, recorded in the video plus depth format, to a collection of heterogeneous clients featuring Internet access links of diverse packet loss and transmission bandwidth values. We design a popularity-aware joint source-channel coding optimization framework that allocates source and channel coding rates to the captured content, such that the aggregate video quality of the reconstructed content across the client population is maximized, for the given packet loss and bandwidth characteristics of the clients and their view selection preferences. The source coding component of our framework features a procedure for generating a view and rate embedded bitstream that is optimally decodable at multiple data rates and accounts for the different popularity of diverse video perspectives of the scene of interest, among the clients. The channel coding component of our framework comprises an expanding-window rateless coding procedure that optimally allocates parity protection bits to the source encoded layers, in order to address packet loss across the unreliable client access links. We develop an optimization method that jointly computes the source and channel coding decisions of our framework, and also design a fast local-search-based solution that exhibits a negligible performance loss relative to the full optimization. We carry out comprehensive simulation experiments and demonstrate significant performance gains over competitive stateof- the-art methods (based on H.264/AVC and network coding, and H.264/SVC and our own channel coding procedure), across different scenario settings and parameter values.

AB - We study the scenario of multicasting multi-view video content, recorded in the video plus depth format, to a collection of heterogeneous clients featuring Internet access links of diverse packet loss and transmission bandwidth values. We design a popularity-aware joint source-channel coding optimization framework that allocates source and channel coding rates to the captured content, such that the aggregate video quality of the reconstructed content across the client population is maximized, for the given packet loss and bandwidth characteristics of the clients and their view selection preferences. The source coding component of our framework features a procedure for generating a view and rate embedded bitstream that is optimally decodable at multiple data rates and accounts for the different popularity of diverse video perspectives of the scene of interest, among the clients. The channel coding component of our framework comprises an expanding-window rateless coding procedure that optimally allocates parity protection bits to the source encoded layers, in order to address packet loss across the unreliable client access links. We develop an optimization method that jointly computes the source and channel coding decisions of our framework, and also design a fast local-search-based solution that exhibits a negligible performance loss relative to the full optimization. We carry out comprehensive simulation experiments and demonstrate significant performance gains over competitive stateof- the-art methods (based on H.264/AVC and network coding, and H.264/SVC and our own channel coding procedure), across different scenario settings and parameter values.

KW - rateless codes

KW - view and rate scalable encoding

KW - channel coding

KW - bandwidth

KW - streaming media

U2 - 10.1109/JSTSP.2015.2402633

DO - 10.1109/JSTSP.2015.2402633

M3 - Article

VL - 9

SP - 474

EP - 486

JO - IEEE Journal on Selected Topics in Signal Processing

JF - IEEE Journal on Selected Topics in Signal Processing

SN - 1932-4553

IS - 3

ER -