Multi-agent Federated Reinforcement Learning for Resource Allocation in UAV-enabled Internet of Medical Things Networks

Authors

Abegaz Mohammed Seid, Hamad Bin Khalifa University, College of Science and Engineering
Aiman Erbad, Hamad Bin Khalifa University, College of Science and Engineering
Hayla Nahom Abishu, University of Electronic Science and Technology of China
Abdullatif Albaseer, Hamad Bin Khalifa University, College of Science and Engineering
Mohamed Abdallah, Hamad Bin Khalifa University, College of Science and Engineering
Mohsen Guizani, Mohamed Bin Zayed University of Artificial IntelligenceFollow

Document Type

Article

Publication Title

IEEE Internet of Things Journal

Abstract

In the 5G/B5G network paradigms, intelligent medical devices known as the Internet of Medical Things (IoMT) have been used in the healthcare industry to monitor remote users’ health status, such as elderly monitoring, injuries, stress, and patients with chronic diseases. Since IoMT devices have limited resources, mobile edge computing (MEC) has been deployed in 5G networks to enable them to offload their tasks to the nearest computational servers for processing. However, when IoMTs are far from network coverage or the computational servers at the terrestrial MEC are overloaded/emergencies occur, these devices cannot access computing services, potentially risking the lives of patients. In this context, unmanned aerial vehicles (UAVs) are considered a prominent aerial connectivity solution for healthcare systems. In this paper, we propose a multi-agent federated reinforcement learning (MAFRL)-based resource allocation framework for a multi-UAV-enabled healthcare system. We formulate the computation offloading and resource allocation problems as a Markov decision process game in federated learning with multiple participants. Then, we propose a MAFRL algorithm to solve the formulated problem, minimize latency and energy consumption, and ensure the quality of service. Finally, extensive simulation results on a real-world heartbeat dataset prove that the proposed MAFRL algorithm significantly minimizes the cost, preserves privacy, and improves accuracy compared to the baseline learning algorithms.

First Page

1

Last Page

1

DOI

10.1109/JIOT.2023.3283353

Publication Date

6-6-2023

Keywords

Computational modeling, Emergency, Federated learning, Healthcare, Industries, Internet of Medical Things, Internet of Things, MARL, Medical services, Monitoring, Privacy, Resource management, UAV

Comments

IR Deposit conditions:

OA version (pathway a) Accepted version

No embargo

When accepted for publication, set statement to accompany deposit (see policy)

Must link to publisher version with DOI

Publisher copyright and source must be acknowledged

Recommended Citation

A. M. Seid, A. Erbad, H. N. Abishu, A. Albaseer, M. Abdallah and M. Guizani, "Multi-agent Federated Reinforcement Learning for Resource Allocation in UAV-enabled Internet of Medical Things Networks," in IEEE Internet of Things Journal, June 2023. doi: 10.1109/JIOT.2023.3283353.