Semantic Communication Enabled Holographic Video Processing and Transmission
Jingkai Ying, Zhiyuan Qi, Yulong Feng, Zhijin Qin, Zhu Han, Rahim Tafazolli, Yonina C. Eldar
TL;DR
The paper tackles the challenge of transmitting holographic video under extreme data-rate and latency constraints by introducing semantic communication to extract and convey meaning rather than raw data. It presents a semantic-enabled HVC architecture featuring semantic sampling, DL-based JSCC, and semantic-aware transmission, with a server as an intermediate processing node for uplink and downlink processing. Two use cases—semantic sampling for point clouds and joint semantic-channel coding with modulation—demonstrate performance gains over traditional approaches, highlighting robustness to channel impairments and reduced data rates. The work points to future research directions including leveraging temporal semantics, reducing computation, and extending semantic methods to other holographic representations such as light fields.
Abstract
Holographic video communication is considered a paradigm shift in visual communications, becoming increasingly popular for its ability to offer immersive experiences. This article provides an overview of holographic video communication and outlines the requirements of a holographic video communication system. Particularly, following a brief review of semantic com- munication, an architecture for a semantic-enabled holographic video communication system is presented. Key technologies, including semantic sampling, joint semantic-channel coding, and semantic-aware transmission, are designed based on the proposed architecture. Two related use cases are presented to demonstrate the performance gain of the proposed methods. Finally, potential research topics are discussed to pave the way for the realization of semantic-enabled holographic video communications.