Semantic Communication Based Video Coding Using Temporal Prediction of Deep Neural Network Parameters

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

14 Downloads (Pure)

Abstract

Video coding is a critical capability that underpins gaming, entertainment and media ecosystems, enabling effective use of video content in both conventional and non-conventional formats. Semantic communications, where semantics alone can be used to reconstruct media content provided that the context of semantic extraction is known, can effectively implement video coding, but techniques to exploit temporal correlations between video frames to achieve better rate distortion performance with them are just beginning to evolve. A novel approach for this problem of predicting the semantic decoder parameters
using temporal correlation is proposed and tested using an autoencoder-based semantic communication system, and the performance is compared with the Neural Network Encoder-
Decoder (NNCodec). Experimental results show that it achieves significantly better rate distortion performance compared to NNCodec alone, with PSNR gains between 3 and 25 dB depending on the complexity of the video and an average bitrate saving of 54%.
Original languageEnglish
Title of host publication2024 IEEE CTSoc Gaming, Entertainment and Media (GEM) Conference
PublisherIEEE
Number of pages6
Publication statusPublished - 7 Jun 2024
Event2024 IEEE CTSoc Gaming, Entertainment and Media (GEM) Conference - Turin, Italy
Duration: 5 Jun 20247 Jun 2024

Conference

Conference2024 IEEE CTSoc Gaming, Entertainment and Media (GEM) Conference
Country/TerritoryItaly
CityTurin
Period5/06/247/06/24

Keywords

  • Autoencoders
  • deep neural networks
  • NNCodec
  • semantic communications
  • video transmission

Fingerprint

Dive into the research topics of 'Semantic Communication Based Video Coding Using Temporal Prediction of Deep Neural Network Parameters'. Together they form a unique fingerprint.

Cite this