Table of Contents
Fetching ...

Optimizing Age of Information in Vehicular Edge Computing with Federated Graph Neural Network Multi-Agent Reinforcement Learning

Wenhua Wang, Qiong Wu, Pingyi Fan, Nan Cheng, Wen Chen, Jiangzhou Wang, Khaled B. Letaief

TL;DR

This work tackles data freshness challenges in Vehicular Edge Computing by targeting AoI under RSU constraints and privacy concerns in learning. It introduces FGNN-MADRL, a framework that fuses Graph Neural Networks with federated learning to generate weighted, graph-aware model aggregations and combines this with a MASAC-based MADRL scheme for cooperative, interference-aware offloading decisions. The key contributions include (i) constructing vehicle-road graphs for distributed FL, (ii) a novel two-tier FL that blends local GNN-based aggregation with centralized global aggregation, and (iii) a MADRL algorithm that reduces decision complexity while achieving high AoI performance. Empirical results show that FGNN-MADRL achieves lower AoI and better adaptability in dynamic road scenarios compared with baselines, highlighting its potential for scalable, privacy-preserving VEC optimization.

Abstract

With the rapid development of intelligent vehicles and Intelligent Transport Systems (ITS), the sensors such as cameras and LiDAR installed on intelligent vehicles provides higher capacity of executing computation-intensive and delay-sensitive tasks, thereby raising deployment costs. To address this issue, Vehicular Edge Computing (VEC) has been proposed to process data through Road Side Units (RSUs) to support real-time applications. This paper focuses on the Age of Information (AoI) as a key metric for data freshness and explores task offloading issues for vehicles under RSU communication resource constraints. We adopt a Multi-agent Deep Reinforcement Learning (MADRL) approach, allowing vehicles to autonomously make optimal data offloading decisions. However, MADRL poses risks of vehicle information leakage during communication learning and centralized training. To mitigate this, we employ a Federated Learning (FL) framework that shares model parameters instead of raw data to protect the privacy of vehicle users. Building on this, we propose an innovative distributed federated learning framework combining Graph Neural Networks (GNN), named Federated Graph Neural Network Multi-Agent Reinforcement Learning (FGNN-MADRL), to optimize AoI across the system. For the first time, road scenarios are constructed as graph data structures, and a GNN-based federated learning framework is proposed, effectively combining distributed and centralized federated aggregation. Furthermore, we propose a new MADRL algorithm that simplifies decision making and enhances offloading efficiency, further reducing the decision complexity. Simulation results demonstrate the superiority of our proposed approach to other methods through simulations.

Optimizing Age of Information in Vehicular Edge Computing with Federated Graph Neural Network Multi-Agent Reinforcement Learning

TL;DR

This work tackles data freshness challenges in Vehicular Edge Computing by targeting AoI under RSU constraints and privacy concerns in learning. It introduces FGNN-MADRL, a framework that fuses Graph Neural Networks with federated learning to generate weighted, graph-aware model aggregations and combines this with a MASAC-based MADRL scheme for cooperative, interference-aware offloading decisions. The key contributions include (i) constructing vehicle-road graphs for distributed FL, (ii) a novel two-tier FL that blends local GNN-based aggregation with centralized global aggregation, and (iii) a MADRL algorithm that reduces decision complexity while achieving high AoI performance. Empirical results show that FGNN-MADRL achieves lower AoI and better adaptability in dynamic road scenarios compared with baselines, highlighting its potential for scalable, privacy-preserving VEC optimization.

Abstract

With the rapid development of intelligent vehicles and Intelligent Transport Systems (ITS), the sensors such as cameras and LiDAR installed on intelligent vehicles provides higher capacity of executing computation-intensive and delay-sensitive tasks, thereby raising deployment costs. To address this issue, Vehicular Edge Computing (VEC) has been proposed to process data through Road Side Units (RSUs) to support real-time applications. This paper focuses on the Age of Information (AoI) as a key metric for data freshness and explores task offloading issues for vehicles under RSU communication resource constraints. We adopt a Multi-agent Deep Reinforcement Learning (MADRL) approach, allowing vehicles to autonomously make optimal data offloading decisions. However, MADRL poses risks of vehicle information leakage during communication learning and centralized training. To mitigate this, we employ a Federated Learning (FL) framework that shares model parameters instead of raw data to protect the privacy of vehicle users. Building on this, we propose an innovative distributed federated learning framework combining Graph Neural Networks (GNN), named Federated Graph Neural Network Multi-Agent Reinforcement Learning (FGNN-MADRL), to optimize AoI across the system. For the first time, road scenarios are constructed as graph data structures, and a GNN-based federated learning framework is proposed, effectively combining distributed and centralized federated aggregation. Furthermore, we propose a new MADRL algorithm that simplifies decision making and enhances offloading efficiency, further reducing the decision complexity. Simulation results demonstrate the superiority of our proposed approach to other methods through simulations.
Paper Structure (27 sections, 34 equations, 8 figures, 3 tables, 2 algorithms)

This paper contains 27 sections, 34 equations, 8 figures, 3 tables, 2 algorithms.

Figures (8)

  • Figure 1: System Scenario
  • Figure 2: Distributed FL Based on GNN.
  • Figure 3: GNN road graph.
  • Figure 4: Learning curve
  • Figure 5: The performance of different ${{L}_{g}}$ trained models under various $\lambda$.
  • ...and 3 more figures