Task-oriented quality assessment and adaptation in real-time mission critical video streaming applications

James Nightingale, Qi Wang, Christos Grecos

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

Abstract

In recent years video traffic has become the dominant application on the Internet with global year-on-year increases in video-oriented consumer services. Driven by improved bandwidth in both mobile and fixed networks, steadily reducing hardware costs and the development of new technologies, many existing and new classes of commercial and industrial video applications are now being upgraded or emerging. Some of the use cases for these applications include areas such as public and private security monitoring for loss prevention or intruder detection, industrial process monitoring and critical infrastructure monitoring. The use of video is becoming commonplace in defence, security, commercial, industrial, educational and health contexts. Towards optimal performances, the design or optimisation in each of these applications should be context aware and task oriented with the characteristics of the video stream (frame rate, spatial resolution, bandwidth etc.) chosen to match the use case requirements. For example, in the security domain, a task-oriented consideration may be that higher resolution video would be required to identify an intruder than to simply detect his presence. Whilst in the same case, contextual factors such as the requirement to transmit over a resource-limited wireless link, may impose constraints on the selection of optimum task-oriented parameters. This paper presents a novel, conceptually simple and easily implemented method of assessing video quality relative to its suitability for a particular task and dynamically adapting videos streams during transmission to ensure that the task can be successfully completed. Firstly we defined two principle classes of tasks: recognition tasks and event detection tasks. These task classes are further subdivided into a set of task-related profiles, each of which is associated with a set of taskoriented attributes (minimum spatial resolution, minimum frame rate etc.). For example, in the detection class, profiles for intruder detection will require different temporal characteristics (frame rate) from those used for detection of high motion objects such as vehicles or aircrafts. We also define a set of contextual attributes that are associated with each instance of a running application that include resource constraints imposed by the transmission system employed and the hardware platforms used as source and destination of the video stream. Empirical results are presented and analysed to demonstrate the advantages of the proposed schemes.

Original languageEnglish
Title of host publicationProceedings of SPIE-IS and T Electronic Imaging - Real-Time Image and Video Processing 2015
Volume9400
DOIs
Publication statusPublished - 1 Jan 2015
EventReal-Time Image and Video Processing 2015 - San Francisco, United States
Duration: 10 Feb 2015 → …

Conference

ConferenceReal-Time Image and Video Processing 2015
CountryUnited States
CitySan Francisco
Period10/02/15 → …

Fingerprint

Video Streaming
Video streaming
Quality Assessment
Real-time
Use Case
Spatial Resolution
Attribute
Bandwidth
Hardware
Loss prevention
Monitoring
Critical infrastructures
Critical Infrastructure
Event Detection
Video Quality
Process Monitoring
Resource Constraints
Process monitoring
Requirements
Context-aware

Keywords

  • context aware
  • H 264/SVC
  • HEVC
  • SHVC
  • task oriented
  • video streaming

Cite this

Nightingale, J., Wang, Q., & Grecos, C. (2015). Task-oriented quality assessment and adaptation in real-time mission critical video streaming applications. In Proceedings of SPIE-IS and T Electronic Imaging - Real-Time Image and Video Processing 2015 (Vol. 9400). [94000M] https://doi.org/10.1117/12.2078741
Nightingale, James ; Wang, Qi ; Grecos, Christos. / Task-oriented quality assessment and adaptation in real-time mission critical video streaming applications. Proceedings of SPIE-IS and T Electronic Imaging - Real-Time Image and Video Processing 2015. Vol. 9400 2015.
@inproceedings{c598474e28fc483689bcc7094117f0f6,
title = "Task-oriented quality assessment and adaptation in real-time mission critical video streaming applications",
abstract = "In recent years video traffic has become the dominant application on the Internet with global year-on-year increases in video-oriented consumer services. Driven by improved bandwidth in both mobile and fixed networks, steadily reducing hardware costs and the development of new technologies, many existing and new classes of commercial and industrial video applications are now being upgraded or emerging. Some of the use cases for these applications include areas such as public and private security monitoring for loss prevention or intruder detection, industrial process monitoring and critical infrastructure monitoring. The use of video is becoming commonplace in defence, security, commercial, industrial, educational and health contexts. Towards optimal performances, the design or optimisation in each of these applications should be context aware and task oriented with the characteristics of the video stream (frame rate, spatial resolution, bandwidth etc.) chosen to match the use case requirements. For example, in the security domain, a task-oriented consideration may be that higher resolution video would be required to identify an intruder than to simply detect his presence. Whilst in the same case, contextual factors such as the requirement to transmit over a resource-limited wireless link, may impose constraints on the selection of optimum task-oriented parameters. This paper presents a novel, conceptually simple and easily implemented method of assessing video quality relative to its suitability for a particular task and dynamically adapting videos streams during transmission to ensure that the task can be successfully completed. Firstly we defined two principle classes of tasks: recognition tasks and event detection tasks. These task classes are further subdivided into a set of task-related profiles, each of which is associated with a set of taskoriented attributes (minimum spatial resolution, minimum frame rate etc.). For example, in the detection class, profiles for intruder detection will require different temporal characteristics (frame rate) from those used for detection of high motion objects such as vehicles or aircrafts. We also define a set of contextual attributes that are associated with each instance of a running application that include resource constraints imposed by the transmission system employed and the hardware platforms used as source and destination of the video stream. Empirical results are presented and analysed to demonstrate the advantages of the proposed schemes.",
keywords = "context aware, H 264/SVC, HEVC, SHVC, task oriented, video streaming",
author = "James Nightingale and Qi Wang and Christos Grecos",
year = "2015",
month = "1",
day = "1",
doi = "10.1117/12.2078741",
language = "English",
volume = "9400",
booktitle = "Proceedings of SPIE-IS and T Electronic Imaging - Real-Time Image and Video Processing 2015",

}

Nightingale, J, Wang, Q & Grecos, C 2015, Task-oriented quality assessment and adaptation in real-time mission critical video streaming applications. in Proceedings of SPIE-IS and T Electronic Imaging - Real-Time Image and Video Processing 2015. vol. 9400, 94000M, Real-Time Image and Video Processing 2015, San Francisco, United States, 10/02/15. https://doi.org/10.1117/12.2078741

Task-oriented quality assessment and adaptation in real-time mission critical video streaming applications. / Nightingale, James; Wang, Qi; Grecos, Christos.

Proceedings of SPIE-IS and T Electronic Imaging - Real-Time Image and Video Processing 2015. Vol. 9400 2015. 94000M.

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

TY - GEN

T1 - Task-oriented quality assessment and adaptation in real-time mission critical video streaming applications

AU - Nightingale, James

AU - Wang, Qi

AU - Grecos, Christos

PY - 2015/1/1

Y1 - 2015/1/1

N2 - In recent years video traffic has become the dominant application on the Internet with global year-on-year increases in video-oriented consumer services. Driven by improved bandwidth in both mobile and fixed networks, steadily reducing hardware costs and the development of new technologies, many existing and new classes of commercial and industrial video applications are now being upgraded or emerging. Some of the use cases for these applications include areas such as public and private security monitoring for loss prevention or intruder detection, industrial process monitoring and critical infrastructure monitoring. The use of video is becoming commonplace in defence, security, commercial, industrial, educational and health contexts. Towards optimal performances, the design or optimisation in each of these applications should be context aware and task oriented with the characteristics of the video stream (frame rate, spatial resolution, bandwidth etc.) chosen to match the use case requirements. For example, in the security domain, a task-oriented consideration may be that higher resolution video would be required to identify an intruder than to simply detect his presence. Whilst in the same case, contextual factors such as the requirement to transmit over a resource-limited wireless link, may impose constraints on the selection of optimum task-oriented parameters. This paper presents a novel, conceptually simple and easily implemented method of assessing video quality relative to its suitability for a particular task and dynamically adapting videos streams during transmission to ensure that the task can be successfully completed. Firstly we defined two principle classes of tasks: recognition tasks and event detection tasks. These task classes are further subdivided into a set of task-related profiles, each of which is associated with a set of taskoriented attributes (minimum spatial resolution, minimum frame rate etc.). For example, in the detection class, profiles for intruder detection will require different temporal characteristics (frame rate) from those used for detection of high motion objects such as vehicles or aircrafts. We also define a set of contextual attributes that are associated with each instance of a running application that include resource constraints imposed by the transmission system employed and the hardware platforms used as source and destination of the video stream. Empirical results are presented and analysed to demonstrate the advantages of the proposed schemes.

AB - In recent years video traffic has become the dominant application on the Internet with global year-on-year increases in video-oriented consumer services. Driven by improved bandwidth in both mobile and fixed networks, steadily reducing hardware costs and the development of new technologies, many existing and new classes of commercial and industrial video applications are now being upgraded or emerging. Some of the use cases for these applications include areas such as public and private security monitoring for loss prevention or intruder detection, industrial process monitoring and critical infrastructure monitoring. The use of video is becoming commonplace in defence, security, commercial, industrial, educational and health contexts. Towards optimal performances, the design or optimisation in each of these applications should be context aware and task oriented with the characteristics of the video stream (frame rate, spatial resolution, bandwidth etc.) chosen to match the use case requirements. For example, in the security domain, a task-oriented consideration may be that higher resolution video would be required to identify an intruder than to simply detect his presence. Whilst in the same case, contextual factors such as the requirement to transmit over a resource-limited wireless link, may impose constraints on the selection of optimum task-oriented parameters. This paper presents a novel, conceptually simple and easily implemented method of assessing video quality relative to its suitability for a particular task and dynamically adapting videos streams during transmission to ensure that the task can be successfully completed. Firstly we defined two principle classes of tasks: recognition tasks and event detection tasks. These task classes are further subdivided into a set of task-related profiles, each of which is associated with a set of taskoriented attributes (minimum spatial resolution, minimum frame rate etc.). For example, in the detection class, profiles for intruder detection will require different temporal characteristics (frame rate) from those used for detection of high motion objects such as vehicles or aircrafts. We also define a set of contextual attributes that are associated with each instance of a running application that include resource constraints imposed by the transmission system employed and the hardware platforms used as source and destination of the video stream. Empirical results are presented and analysed to demonstrate the advantages of the proposed schemes.

KW - context aware

KW - H 264/SVC

KW - HEVC

KW - SHVC

KW - task oriented

KW - video streaming

UR - http://www.scopus.com/inward/record.url?scp=84925665387&partnerID=8YFLogxK

U2 - 10.1117/12.2078741

DO - 10.1117/12.2078741

M3 - Conference contribution book

VL - 9400

BT - Proceedings of SPIE-IS and T Electronic Imaging - Real-Time Image and Video Processing 2015

ER -

Nightingale J, Wang Q, Grecos C. Task-oriented quality assessment and adaptation in real-time mission critical video streaming applications. In Proceedings of SPIE-IS and T Electronic Imaging - Real-Time Image and Video Processing 2015. Vol. 9400. 2015. 94000M https://doi.org/10.1117/12.2078741