A PDDQNLP Algorithm for Energy Efficient Computation Offloading in UAV-assisted MEC

Authors

Na Lin, Shenyang Aerospace University
Hailun Tang, Shenyang Aerospace University
Liang Zhao, Shenyang Aerospace University
Shaohua Wan, University of Electronic Science and Technology of China
Ammar Hawbani, University of Science and Technology of China
Mohsen Guizani, Mohamed Bin Zayed University of Artificial IntelligenceFollow

Document Type

Article

Publication Title

IEEE Transactions on Wireless Communications

Abstract

Unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC) is a promising technology to provide computational services to ground terminal devices (TDs) in remote areas or for emergency incidents with its flexibility and mobility. This paper aims to maximize the UAV’s energy efficiency while considering the fairness of offloading. We formulate this optimization problem by jointly considering the UAV flight time, the UAV 3D trajectory, the TD binary offloading decisions, and the time allocated to TDs, which is a mixed-integer nonlinear programming problem. The problem is transformed into two sub-problems and we propose a PDDQNLP (parametrized dueling deep Q-network and linear programming) algorithm based on the combination of deep reinforcement learning (DRL) and linear programming (LP) to address them. For the first sub-problem, a DRL-based algorithm is used to optimize the TD offloading decisions, the UAV trajectory, and the UAV flight time. The action space is hybrid that contains discrete actions (e.g., binary offloading) and continuous actions (e.g., UAV flight time). Therefore, we parameterize the action space and propose the PDDQN algorithm, which combines the DDPG algorithm for handling the continuous action space and the Dueling DQN algorithm for handling the discrete action space. According to the solution obtained from the first sub-problem, the LP is used to adjust the time allocated to TDs in the second sub-problem. The numerical results show that the PDDQNLP algorithm outperforms its counterparts.

First Page

1

Last Page

1

DOI

10.1109/TWC.2023.3266497

Publication Date

4-18-2023

Keywords

computation offloading, Computational modeling, Energy consumption, energy efficiency, Energy efficiency, MEC, Optimization, PDDQN, Resource management, Throughput, time optimization, Trajectory, UAV

Comments

IR Deposit conditions:

OA version (pathway a) Accepted version

No embargo

When accepted for publication, set statement to accompany deposit (see policy)

Must link to publisher version with DOI

Publisher copyright and source must be acknowledged

Recommended Citation

N. Lin, H. Tang, L. Zhao, S. Wan, A. Hawbani and M. Guizani, "A PDDQNLP Algorithm for Energy Efficient Computation Offloading in UAV-assisted MEC," in IEEE Transactions on Wireless Communications, April 2023, doi: 10.1109/TWC.2023.3266497.