Multi-agent reinforcement learning based optimal energy sensing threshold control in distributed cognitive radio networks with directional antenna
DC Field | Value | Language |
---|---|---|
dc.contributor.author | Pham, Thi Thu Hien | - |
dc.contributor.author | Noh, Wonjong | - |
dc.contributor.author | Cho, Sungrae | - |
dc.date.accessioned | 2024-03-13T02:00:20Z | - |
dc.date.available | 2024-03-13T02:00:20Z | - |
dc.date.issued | 2024 | - |
dc.identifier.issn | 2405-9595 | - |
dc.identifier.issn | 2405-9595 | - |
dc.identifier.uri | https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/72787 | - |
dc.description.abstract | In CRNs, it is crucial to develop an efficient and reliable spectrum detector that consistently provides accurate information about the channel state. In this work, we investigate a CSS in a fully-distributed environment where all secondary users (SUs) are equipped with directional antennas and make decisions based solely on their local knowledge without information sharing between SUs. First, we establish a stochastic sequential optimization problem, which is an NP-hard, that maximizes the SU's detection accuracy by the dynamic and optimal control of the energy sensing/detection threshold. It can enable SUs to select an available channel and sector without causing interference to the primary network. To address it in a distributed environment, the problem is transformed into a decentralized partially observed Markov decision process (Dec-POMDP) problem. Second, in order to determine the best control for the Dec-POMDP in a practical environment without any prior knowledge of state–action transition probabilities, we develop a multi-agent deep deterministic policy gradient (MADDPG)-based algorithm, which is referred to as MA-DCSS. This algorithm adopts the centralized training and decentralized execution (CTDE) architecture. Third, we analyzed its computational complexity and showed the proposed approach's scalability by the polynomial computational complexity, in terms of the number of channels, sectors, and SUs. Lastly, the simulation confirms that the proposed scheme provides enhanced performance in terms of convergence speed, accurate detection, and false alarm probabilities when it is compared to baseline algorithms. © 2024 The Author(s) | - |
dc.format.extent | 7 | - |
dc.language | 영어 | - |
dc.language.iso | ENG | - |
dc.publisher | Korean Institute of Communications and Information Sciences | - |
dc.title | Multi-agent reinforcement learning based optimal energy sensing threshold control in distributed cognitive radio networks with directional antenna | - |
dc.title.alternative | Multi-agent reinforcement learning based optimal energy sensing threshold control in distributed cognitive radio networks with directional antenna | - |
dc.type | Article | - |
dc.identifier.doi | 10.1016/j.icte.2024.01.001 | - |
dc.identifier.bibliographicCitation | ICT Express, v.10, no.3, pp 472 - 478 | - |
dc.identifier.kciid | ART003089717 | - |
dc.description.isOpenAccess | Y | - |
dc.identifier.scopusid | 2-s2.0-85183185368 | - |
dc.citation.endPage | 478 | - |
dc.citation.number | 3 | - |
dc.citation.startPage | 472 | - |
dc.citation.title | ICT Express | - |
dc.citation.volume | 10 | - |
dc.type.docType | Article in press | - |
dc.publisher.location | 대한민국 | - |
dc.subject.keywordAuthor | Cognitive radio networks | - |
dc.subject.keywordAuthor | CRNs | - |
dc.subject.keywordAuthor | Cooperative spectrum sensing | - |
dc.subject.keywordAuthor | CSS | - |
dc.subject.keywordAuthor | Directional antennas | - |
dc.subject.keywordAuthor | Multi-agent deep deterministic policy gradient | - |
dc.subject.keywordAuthor | MADDPG | - |
dc.subject.keywordAuthor | Reinforcement learning | - |
dc.subject.keywordAuthor | RL | - |
dc.description.journalRegisteredClass | scie | - |
dc.description.journalRegisteredClass | scopus | - |
dc.description.journalRegisteredClass | kci | - |
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.
84, Heukseok-ro, Dongjak-gu, Seoul, Republic of Korea (06974)02-820-6194
COPYRIGHT 2019 Chung-Ang University All Rights Reserved.
Certain data included herein are derived from the © Web of Science of Clarivate Analytics. All rights reserved.
You may not copy or re-distribute this material in whole or in part without the prior written consent of Clarivate Analytics.