Deep Reinforcement Learning for Time Scheduling in RF-Powered Backscatter Cognitive Radio Networks
- Authors
- Anh, T.T.[Anh, T.T.]; Luong, N.C.[Luong, N.C.]; Niyato, D.[Niyato, D.]; Liang, Y.-C.[Liang, Y.-C.]; Kim, D.I.[Kim, D.I.]
- Issue Date
- 2019
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- ambient backscatter; Cognitive radio networks; deep reinforcement learning; RF energy harvesting; time scheduling
- Citation
- IEEE Wireless Communications and Networking Conference, WCNC, v.2019-April
- Indexed
- SCOPUS
- Journal Title
- IEEE Wireless Communications and Networking Conference, WCNC
- Volume
- 2019-April
- URI
- https://scholarworks.bwise.kr/skku/handle/2021.sw.skku/13816
- DOI
- 10.1109/WCNC.2019.8885426
- ISSN
- 1525-3511
- Abstract
- In an RF-powered backscatter cognitive radio network, multiple secondary users communicate with a secondary gateway by backscattering or harvesting energy and actively transmitting their data depending on the primary channel state. To coordinate the transmission of multiple secondary transmitters, the secondary gateway needs to schedule the backscattering time, energy harvesting time, and transmission time among them. However, under the dynamics of the primary channel and the uncertainty of the energy state of the secondary transmitters, it is challenging for the gateway to find a time scheduling mechanism which maximizes the total throughput. In this paper, we propose to use the deep reinforcement learning algorithm to derive an optimal time scheduling policy for the gateway. Specifically, to deal with the problem with large state and action spaces, we adopt a Double Deep-Q Network (DDQN) that enables the gateway to learn the optimal policy. The simulation results clearly show that the proposed deep reinforcement learning algorithm outperforms non-learning schemes in terms of network throughput. © 2019 IEEE.
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - Information and Communication Engineering > School of Electronic and Electrical Engineering > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.