Three-Stage Stackelberg Game Enabled Clustered Federated Learning in Heterogeneous UAV Swarms

Authors

Wenji He, Beijing University of Posts and Telecommunications
Haipeng Yao, Beijing University of Posts and Telecommunications
Tianle Mai, Beijing University of Posts and Telecommunications
Fu Wang, Beijing University of Posts and Telecommunications
Mohsen Guizani, Mohamed Bin Zayed University of Artificial IntelligenceFollow

Document Type

Article

Publication Title

IEEE Transactions on Vehicular Technology

Abstract

In the past decade, the unmanned aerial vehicles (UAVs) swarm has become the disruptive force reshaping our lives and work. In particular, advances in artificial intelligence have allowed multiple UAVs to coordinate their operations and work together to accomplish various complex tasks, one of which is Federated Learning (FL). As a promising distributed learning paradigm, FL can be adopted well with the limited resources and dynamic network topology of UAV swarms. However, the current FL's training process relies on homogeneous data paradigms, which require distributed UAVs to hold the same structure data. This ideal hypothesis is can not apply to the heterogeneous UAV swarms. To tackle this problem, in this paper, we design a clustered federated learning (CFL) architecture, in which we cluster UAV swarms based on the similarities between the participants' optimization directions. Then, we formulate the model trading among model owners, cluster heads, and UAV workers as a three-stage Stackelberg game to optimize the allocation of the limited resources. We design a hierarchical reinforcement learning algorithm to search for the Stackelberg equilibrium under the clustered federated learning system. The performance evaluation demonstrates the uniqueness and stability of the proposed three-stage master-slave game under the clustered framework, as well as the convergence and effectiveness of the reinforcement learning algorithm.

First Page

1

Last Page

15

DOI

10.1109/TVT.2023.3246636

Publication Date

2-23-2023

Keywords

Autonomous aerial vehicles, Biological system modeling, clustered federated learning, Data models, Federated learning, Games, multi-agent reinforcement learning, Stackelberg game, Task analysis, Training, UAV swarms

Comments

IR Deposit conditions:

OA version (pathway a) Accepted version

No embargo

When accepted for publication, set statement to accompany deposit (see policy)

Must link to publisher version with DOI

Publisher copyright and source must be acknowledged

Recommended Citation

W. He, H. Yao, T. Mai, F. Wang and M. Guizani, "Three-Stage Stackelberg Game Enabled Clustered Federated Learning in Heterogeneous UAV Swarms," in IEEE Transactions on Vehicular Technology, pp.1-15, Feb 2023, doi: 10.1109/TVT.2023.3246636.