Two Birds with One Stone: Multi-Task Semantic Communications Systems over Relay Channel

TL;DR

A novel multi-task, multi-link relay semantic communications (MTML-RSC) scheme that enables the destination node to simultaneously perform image reconstruction and classification with one transmission from the source node.

Abstract

In this paper, we propose a novel multi-task, multi-link relay semantic communications (MTML-RSC) scheme that enables the destination node to simultaneously perform image reconstruction and classification with one transmission from the source node. In the MTML-RSC scheme, the source node broadcasts a signal using semantic communications, and the relay node forwards the signal to the destination. We analyze the coupling relationship between the two tasks and the two links (source-to-relay and source-to-destination) and design a semantic-focused forward method for the relay node, where it selectively forwards only the semantics of the relevant class while ignoring others. At the destination, the node combines signals from both the source node and the relay node to perform classification, and then uses the classification result to assist in decoding the signal from the relay node for image reconstructing. Experimental results demonstrate that the proposed MTML-RSC scheme achieves significant performance gains, e.g., $1.73$ dB improvement in peak-signal-to-noise ratio (PSNR) for image reconstruction and increasing the accuracy from $64.89\%$ to $70.31\%$ for classification.

Figures (7)

• Figure 1: The overall architecture of the proposed MTML-RSC scheme.
• Figure 2: The structure of the designed class-aided JSCC encoder and decoder.
• Figure 3: The structure of the designed mutual attention module.
• Figure 4: The PSNR performance versus SNR with $d_{SR}=d_{RD}=0.5$. Each link are both the AWGN and Rayleigh fading channels.
• Figure 5: The accuracy versus SNR with $d_{SR}=d_{RD}=0.5$. Each link are both the AWGN and Rayleigh fading channels

Theorems & Definitions (1)

• Remark 1