DNN Task Assignment in UAV Networks: A Generative AI Enhanced Multi-Agent Reinforcement Learning Approach

  • 2024-12-13 05:48:45
  • Xin Tang, Qian Chen, Wenjie Weng, Binhan Liao, Jiacheng Wang, Xianbin Cao, Xiaohuan Li
  • 0

Abstract

Unmanned Aerial Vehicles (UAVs) possess high mobility and flexible deploymentcapabilities, prompting the development of UAVs for various applicationscenarios within the Internet of Things (IoT). The unique capabilities of UAVsgive rise to increasingly critical and complex tasks in uncertain andpotentially harsh environments. The substantial amount of data generated fromthese applications necessitates processing and analysis through deep neuralnetworks (DNNs). However, UAVs encounter challenges due to their limitedcomputing resources when managing DNN models. This paper presents a jointapproach that combines multiple-agent reinforcement learning (MARL) andgenerative diffusion models (GDM) for assigning DNN tasks to a UAV swarm, aimedat reducing latency from task capture to result output. To address thesechallenges, we first consider the task size of the target area to be inspectedand the shortest flying path as optimization constraints, employing a greedyalgorithm to resolve the subproblem with a focus on minimizing the UAV's flyingpath and the overall system cost. In the second stage, we introduce a novel DNNtask assignment algorithm, termed GDM-MADDPG, which utilizes the reversedenoising process of GDM to replace the actor network in multi-agent deepdeterministic policy gradient (MADDPG). This approach generates specific DNNtask assignment actions based on agents' observations in a dynamic environment.Simulation results indicate that our algorithm performs favorably compared tobenchmarks in terms of path planning, Age of Information (AoI), energyconsumption, and task load balancing.