Multi-Agent Reinforcement Learning-Based Resource Allocation Scheme for UAV-Assisted Internet of Remote Things Systemsopen access
- Authors
- Lee, Donggu; Sun, Young Ghyu; Kim, Soo Hyun; Kim, Jae-Hyun; Shin, Yoan; Kim, Dong In; Kim, Jin Young
- Issue Date
- May-2023
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Deep learning; IoRT; multi-agent reinforcement learning; neural episodic control; resource allocation
- Citation
- IEEE ACCESS, v.11, pp.53155 - 53164
- Journal Title
- IEEE ACCESS
- Volume
- 11
- Start Page
- 53155
- End Page
- 53164
- URI
- http://scholarworks.bwise.kr/ssu/handle/2018.sw.ssu/44154
- DOI
- 10.1109/ACCESS.2023.3279401
- ISSN
- 2169-3536
- Abstract
- Multi-layered communication networks including satellites and unmanned aerial vehicles (UAVs) with remote sensing capability are expected to be an essential part of next-generation wireless communication systems. It has been reported that deep reinforcement learning algorithm brings performance improvement in various practical wireless communication environments. However, it is anticipated that the computational complexity will be a critical issue as the number of devices in the network is significantly increased. To resolve this problem, in this paper we propose a multi-agent reinforcement learning (MARL)-based resource allocation scheme for UAV-assisted Internet of remote things (IoRT) systems. The UAV and IoRT sensors are set to be MARL agents, which are independently trained to minimize energy consumption cost for communication by controlling the transmit power and bandwidth. It is shown that the UAV agent can reduce energy consumption by 70.9195 kJ, while the IoRT sensor agents yield 20.5756 kJ reduction, which are 65.4 % and 71.97 % reductions compared to the initial state of each agent. Moreover, the effects from the hyperparameters of the neural episodic control (NEC) baseline algorithm are investigated in terms of power consumption.
- Files in This Item
-
Go to Link
- Appears in
Collections - ETC > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.