Dynamic Mask Enhanced Intelligent Multi-UAV Deployment for Urban Vehicular Networks

Abstract

Vehicular Ad Hoc Networks (VANETs) play a crucial role in realizing vehicle-road collaboration and intelligent transportation. However, urban VANETs often face challenges such as frequent link disconnections and subnet fragmentation, which hinder reliable connectivity. To address these issues, we dynamically deploy multiple Unmanned Aerial Vehicles (UAVs) as communication relays to enhance VANET. A novel Score based Dynamic Action Mask enhanced QMIX algorithm (Q-SDAM) is proposed for multi-UAV deployment, which maximizes vehicle connectivity while minimizing multi-UAV energy consumption. Specifically, we design a score-based dynamic action mask mechanism to guide UAV agents in exploring large action spaces, accelerate the learning process and enhance optimization performance. The practicality of Q-SDAM is validated using real-world datasets. We show that Q-SDAM improves connectivity by 18.2% while reducing energy consumption by 66.6% compared with existing algorithms.

Figures (7)

• Figure 1: Multi-UAV Enhanced VANET Scenario
• Figure 2: Illustration of RTG and DRTG
• Figure 3: Architecture of Q-SDAM
• Figure 4: Roadmap of Scenarios
• Figure 5: Converge of Intelligent Algorithms