Multi-Agent Deep Reinforcement Learning for Interference-Aware Channel Allocation in Non-Terrestrial Networks
- Authors
- Cho, Yeongi; Yang, Wooyeol; Oh, Daesub; Jo, Han-Shin
- Issue Date
- Mar-2023
- Publisher
- IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
- Keywords
- Deep reinforcement learning (DRL); interference mitigation; multi-beam channel allocation; non-terrestrial network (NTN); spectrum sharing
- Citation
- IEEE Communications Letters, v.27, no.3, pp.936 - 940
- Indexed
- SCIE
SCOPUS
- Journal Title
- IEEE Communications Letters
- Volume
- 27
- Number
- 3
- Start Page
- 936
- End Page
- 940
- URI
- https://scholarworks.bwise.kr/hanyang/handle/2021.sw.hanyang/192181
- DOI
- 10.1109/LCOMM.2023.3237207
- ISSN
- 1089-7798
- Abstract
- Non-terrestrial network (NTN) services using low-Earth-orbit (LEO) satellites are expanding. Interference management of NTN services with other terrestrial wireless services is emerging as a critical issue owing to the inherent international and vast coverage nature of NTN. This study develops a multi-agent deep reinforcement learning (DRL) framework to establish a multi-beam uplink channel allocation strategy that minimizes interference with incumbent stations under the given quality of service (QoS) constraints. We propose a novel framework with the sequential training of agents in a specific order to overcome the inherent non-stationarity of multi-agent DRL. To improve learning efficiency, we design the training sequence in accordance with reward function and initial state. As a result, taking actions in the order of the largest interference to the incumbent station provides superior performance to taking actions in an arbitrary order. Moreover, the proposed channel allocation performs close to the optimal exhaustive search and outperforms conventional greedy graph coloring method.
- Files in This Item
-
Go to Link
- Appears in
Collections - 서울 공과대학 > 서울 미래자동차공학과 > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.