Reinforcement-Learning-Based Spatial Resource Identification for IoT D2D Communications
- Authors
- Na, Woongsoo; Dao, Nhu-Ngoc.; Cho, Sungrae
- Issue Date
- Mar-2022
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Keywords
- Deafness; Device-to-device (D2D) communication; Device-to-device communication; directional identification; Directive antennas; Internet of Things; Internet of Things (IoTs) networks; radio resource harvesting edge (RRHE); Sensors; Switches; Transmitting antennas
- Citation
- IEEE Systems Journal, v.16, no.1, pp 1068 - 1079
- Pages
- 12
- Journal Title
- IEEE Systems Journal
- Volume
- 16
- Number
- 1
- Start Page
- 1068
- End Page
- 1079
- URI
- https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/49031
- DOI
- 10.1109/JSYST.2021.3087167
- ISSN
- 1932-8184
1937-9234
- Abstract
- The exponential growth of the Internet of Things (IoTs) has led to an increasing demand for intelligent IoT devices (IoTDs), requiring innovative network capacity expansion. Recently, several research has been conducted on the identification of hidden network resources for network capacity expansion. However, the spatial resource identification scheme through the omnidirectional antenna has limitations in terms of frequency efficiency compared to the scheme with the directional antenna. In this article, we propose a directional spatial-resource identification technique for device-to-device (D2D) communication. To find the optimal identification parameters, we design the objective function and apply a reinforcement learning. The training data used for reinforcement learning are collected in each report phase, and <formula><tex>$Q$</tex></formula>-learning is applied to find the optimal beam set. Furthermore, based on the obtained frequency information, we propose a contention-based D2D communication scheme. The proposed contention-based D2D communication scheme can efficiently solve the deafness problem occurring in a directional D2D communication. Finally, we perform a simulation using optimum network performance (OPNET) to measure the performance and evaluate the effectiveness of the proposed technique. The simulation results show that the proposed schemes realize a better performance than the existing schemes proposed in previous works in terms of energy efficiency, frequency efficiency, aggregate network throughput, and deafness duration. IEEE
- Files in This Item
- There are no files associated with this item.
- Appears in
Collections - College of Software > School of Computer Science and Engineering > 1. Journal Articles
![qrcode](https://api.qrserver.com/v1/create-qr-code/?size=55x55&data=https://scholarworks.bwise.kr/cau/handle/2019.sw.cau/49031)
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.